Nov 14 06:25:25 user nova-compute[75354]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75354) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 06:25:25 user nova-compute[75354]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75354) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 06:25:25 user nova-compute[75354]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75354) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 06:25:25 user nova-compute[75354]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:25:26 user nova-compute[75354]: INFO nova.virt.driver [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 06:25:26 user nova-compute[75354]: INFO nova.compute.provider_config [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Acquiring lock "singleton_lock" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Acquired lock "singleton_lock" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Releasing lock "singleton_lock" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Full set of CONF: {{(pid=75354) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ******************************************************************************** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Configuration options gathered from: {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ================================================================================ {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] allow_resize_to_same_host      = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] arq_binding_timeout            = 300 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] backdoor_port                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] backdoor_socket                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] block_device_allocate_retries  = 300 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] block_device_allocate_retries_interval = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cert                           = self.pem {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute_monitors               = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] config_dir                     = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] config_drive_format            = iso9660 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] config_source                  = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] console_host                   = user {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] control_exchange               = nova {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cpu_allocation_ratio           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] daemon                         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] debug                          = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] default_access_ip_network_name = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] default_availability_zone      = nova {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] default_ephemeral_format       = ext4 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] default_green_pool_size        = 1000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] default_schedule_zone          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] disk_allocation_ratio          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] enable_new_services            = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] enabled_apis                   = ['osapi_compute'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] enabled_ssl_apis               = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] flat_injected                  = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] force_config_drive             = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] force_raw_images               = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] graceful_shutdown_timeout      = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] heal_instance_info_cache_interval = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] host                           = user {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_build_timeout         = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_delete_interval       = 300 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_format                = [instance: %(uuid)s]  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_name_template         = instance-%08x {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_usage_audit           = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_usage_audit_period    = month {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] internal_service_availability_zone = internal {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] key                            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] live_migration_retry_count     = 30 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_config_append              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_dir                        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_file                       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_options                    = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_rotate_interval            = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_rotate_interval_type       = days {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] log_rotation_type              = none {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] long_rpc_timeout               = 1800 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] max_concurrent_builds          = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] max_concurrent_live_migrations = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] max_concurrent_snapshots       = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] max_local_block_devices        = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] max_logfile_count              = 30 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] max_logfile_size_mb            = 200 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] maximum_instance_delete_attempts = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metadata_listen                = 0.0.0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metadata_listen_port           = 8775 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metadata_workers               = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] migrate_max_retries            = -1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] mkisofs_cmd                    = genisoimage {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] my_ip                          = 10.0.0.210 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] network_allocate_retries       = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] osapi_compute_listen_port      = 8774 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] osapi_compute_unique_server_name_scope =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] osapi_compute_workers          = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] password_length                = 12 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] periodic_enable                = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] periodic_fuzzy_delay           = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] pointer_model                  = ps2mouse {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] preallocate_images             = none {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] publish_errors                 = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] pybasedir                      = /opt/stack/nova {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ram_allocation_ratio           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rate_limit_burst               = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rate_limit_except_level        = CRITICAL {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rate_limit_interval            = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reboot_timeout                 = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reclaim_instance_interval      = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] record                         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reimage_timeout_per_gb         = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] report_interval                = 120 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rescue_timeout                 = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reserved_host_cpus             = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reserved_host_disk_mb          = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reserved_host_memory_mb        = 512 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] reserved_huge_pages            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] resize_confirm_window          = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] resize_fs_using_block_device   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] resume_guests_state_on_host_boot = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rpc_response_timeout           = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] run_external_periodic_tasks    = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] running_deleted_instance_action = reap {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] running_deleted_instance_poll_interval = 1800 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] running_deleted_instance_timeout = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler_instance_sync_interval = 120 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_down_time              = 720 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] servicegroup_driver            = db {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] shelved_offload_time           = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] shelved_poll_interval          = 3600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] shutdown_timeout               = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] source_is_ipv6                 = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ssl_only                       = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] state_path                     = /opt/stack/data/nova {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] sync_power_state_interval      = 600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] sync_power_state_pool_size     = 1000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] syslog_log_facility            = LOG_USER {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] tempdir                        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] timeout_nbd                    = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] transport_url                  = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] update_resources_interval      = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_cow_images                 = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_eventlog                   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_journal                    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_json                       = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_rootwrap_daemon            = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_stderr                     = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] use_syslog                     = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vcpu_pin_set                   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plugging_is_fatal          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plugging_timeout           = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] virt_mkfs                      = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] volume_usage_poll_interval     = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] watch_log_file                 = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] web                            = /usr/share/spice-html5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_concurrency.disable_process_locking = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.auth_strategy              = keystone {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.compute_link_prefix        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.dhcp_domain                = novalocal {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.enable_instance_password   = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.glance_link_prefix         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.instance_list_per_project_cells = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.list_records_by_skipping_down_cells = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.local_metadata_per_cell    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.max_limit                  = 1000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.metadata_cache_expiration  = 15 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.neutron_default_tenant_id  = default {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.use_forwarded_for          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.use_neutron_default_nets   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_dynamic_targets = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_jsonfile_path   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.backend                  = dogpile.cache.memcached {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.backend_argument         = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.config_prefix            = cache.oslo {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.dead_timeout             = 60.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.debug_cache_backend      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.enable_retry_client      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.enable_socket_keepalive  = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.enabled                  = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.expiration_time          = 600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.hashclient_retry_attempts = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_dead_retry      = 300 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_password        =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_pool_maxsize    = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_sasl_enabled    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.memcache_username        =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.proxies                  = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.retry_attempts           = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.retry_delay              = 0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.socket_keepalive_count   = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.socket_keepalive_idle    = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.socket_keepalive_interval = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.tls_allowed_ciphers      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.tls_cafile               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.tls_certfile             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.tls_enabled              = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cache.tls_keyfile              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.auth_section            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.auth_type               = password {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.cafile                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.certfile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.collect_timing          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.cross_az_attach         = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.debug                   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.endpoint_template       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.http_retries            = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.insecure                = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.keyfile                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.os_region_name          = RegionOne {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.split_loggers           = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cinder.timeout                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.cpu_dedicated_set      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.cpu_shared_set         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.image_type_exclude_list = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.max_concurrent_disk_ops = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.max_disk_devices_to_attach = -1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.resource_provider_association_refresh = 300 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.shutdown_retry_interval = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] conductor.workers              = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] console.allowed_origins        = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] console.ssl_ciphers            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] console.ssl_minimum_version    = default {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] consoleauth.token_ttl          = 600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.cafile                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.certfile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.collect_timing          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.connect_retries         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.connect_retry_delay     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.endpoint_override       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.insecure                = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.keyfile                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.max_version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.min_version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.region_name             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.service_name            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.service_type            = accelerator {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.split_loggers           = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.status_code_retries     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.timeout                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] cyborg.version                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.backend               = sqlalchemy {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.connection            = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.connection_debug      = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.connection_parameters =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.connection_recycle_time = 3600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.connection_trace      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.db_inc_retry_interval = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.db_max_retries        = 20 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.db_max_retry_interval = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.db_retry_interval     = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.max_overflow          = 50 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.max_pool_size         = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.max_retries           = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.mysql_wsrep_sync_wait = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.pool_timeout          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.retry_interval        = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.slave_connection      = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] database.sqlite_synchronous    = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.backend           = sqlalchemy {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.connection        = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.connection_debug  = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.connection_parameters =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.connection_recycle_time = 3600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.connection_trace  = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.db_inc_retry_interval = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.db_max_retries    = 20 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.db_max_retry_interval = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.db_retry_interval = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.max_overflow      = 50 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.max_pool_size     = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.max_retries       = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.pool_timeout      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.retry_interval    = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.slave_connection  = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] api_database.sqlite_synchronous = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] devices.enabled_mdev_types     = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ephemeral_storage_encryption.enabled = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.api_servers             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.cafile                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.certfile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.collect_timing          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.connect_retries         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.connect_retry_delay     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.debug                   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.default_trusted_certificate_ids = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.enable_certificate_validation = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.enable_rbd_download     = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.endpoint_override       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.insecure                = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.keyfile                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.max_version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.min_version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.num_retries             = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.rbd_ceph_conf           =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.rbd_connect_timeout     = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.rbd_pool                =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.rbd_user                =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.region_name             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.service_name            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.service_type            = image {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.split_loggers           = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.status_code_retries     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.timeout                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.verify_glance_signatures = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] glance.version                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] guestfs.debug                  = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.config_drive_cdrom      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.config_drive_inject_password = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.enable_instance_metrics_collection = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.enable_remotefx         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.instances_path_share    =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.iscsi_initiator_list    = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.limit_cpu_features      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.power_state_check_timeframe = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.use_multipath_io        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.volume_attach_retry_count = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.vswitch_name            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] mks.enabled                    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] image_cache.manager_interval   = 2400 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] image_cache.precache_concurrency = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] image_cache.remove_unused_base_images = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] image_cache.subdirectory_name  = _base {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.api_max_retries         = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.api_retry_interval      = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.auth_section            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.auth_type               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.cafile                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.certfile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.collect_timing          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.conductor_group         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.connect_retries         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.connect_retry_delay     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.endpoint_override       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.insecure                = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.keyfile                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.max_version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.min_version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.peer_list               = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.region_name             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.serial_console_state_timeout = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.service_name            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.service_type            = baremetal {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.split_loggers           = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.status_code_retries     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.timeout                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ironic.version                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] key_manager.fixed_key          = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.barbican_api_version  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.barbican_endpoint     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.barbican_endpoint_type = public {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.barbican_region_name  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.cafile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.certfile              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.collect_timing        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.insecure              = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.keyfile               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.number_of_retries     = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.retry_delay           = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.send_service_user_token = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.split_loggers         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.timeout               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.verify_ssl            = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican.verify_ssl_path       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.auth_section = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.auth_type = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.cafile   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.certfile = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.collect_timing = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.insecure = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.keyfile  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.split_loggers = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] barbican_service_user.timeout  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.approle_role_id          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.approle_secret_id        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.cafile                   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.certfile                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.collect_timing           = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.insecure                 = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.keyfile                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.kv_mountpoint            = secret {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.kv_path                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.kv_version               = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.namespace                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.root_token_id            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.split_loggers            = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.ssl_ca_crt_file          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.timeout                  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.use_ssl                  = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.auth_section          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.auth_type             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.cafile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.certfile              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.collect_timing        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.connect_retries       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.connect_retry_delay   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.endpoint_override     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.insecure              = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.keyfile               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.max_version           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.min_version           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.region_name           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.service_name          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.service_type          = identity {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.split_loggers         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.status_code_retries   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.timeout               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] keystone.version               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.connection_uri         =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_mode               = custom {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: WARNING oslo_config.cfg [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_power_governor_high = performance {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_power_governor_low = powersave {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_power_management   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.device_detach_attempts = 8 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.device_detach_timeout  = 20 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.disk_cachemodes        = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.disk_prefix            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.enabled_perf_events    = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.file_backed_memory     = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.gid_maps               = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.hw_disk_discard        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.hw_machine_type        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_rbd_glance_store_name =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_rbd_pool        = rbd {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_type            = default {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.images_volume_group    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.inject_key             = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.inject_partition       = -2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.inject_password        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.iscsi_iface            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.iser_use_multipath     = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_bandwidth = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_downtime = 500 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_inbound_addr = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_permit_post_copy = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_scheme  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_timeout_action = abort {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_tunnelled = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: WARNING oslo_config.cfg [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 06:25:26 user nova-compute[75354]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 06:25:26 user nova-compute[75354]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 06:25:26 user nova-compute[75354]: and ``live_migration_inbound_addr`` respectively.
Nov 14 06:25:26 user nova-compute[75354]: ).  Its value may be silently ignored in the future.
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.live_migration_with_native_tls = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.max_queues             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.nfs_mount_options      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.num_memory_encrypted_guests = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.num_pcie_ports         = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.pmem_namespaces        = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.quobyte_client_cfg     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rbd_secret_uuid        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rbd_user               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.remote_filesystem_transport = ssh {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rescue_image_id        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rescue_kernel_id       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rescue_ramdisk_id      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.rx_queue_size          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.smbfs_mount_options    =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.snapshot_compression   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.snapshot_image_format  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.sparse_logical_volumes = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.swtpm_enabled          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.swtpm_group            = tss {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.swtpm_user             = tss {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.sysinfo_serial         = unique {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.tb_cache_size          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.tx_queue_size          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.uid_maps               = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.use_virtio_for_bridges = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.virt_type              = kvm {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.volume_clear           = zero {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.volume_clear_size      = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.volume_use_multipath   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_cache_path   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.vzstorage_mount_user   = stack {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.auth_section           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.auth_type              = password {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.cafile                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.certfile               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.collect_timing         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.connect_retries        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.connect_retry_delay    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.default_floating_pool  = public {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.endpoint_override      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.extension_sync_interval = 600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.http_retries           = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.insecure               = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.keyfile                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.max_version            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.min_version            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.ovs_bridge             = br-int {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.physnets               = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.region_name            = RegionOne {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.service_metadata_proxy = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.service_name           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.service_type           = network {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.split_loggers          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.status_code_retries    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.timeout                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] neutron.version                = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] notifications.bdms_in_notifications = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] notifications.default_level    = INFO {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] notifications.notification_format = unversioned {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] notifications.notify_on_state_change = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] pci.alias                      = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] pci.device_spec                = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] pci.report_in_placement        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.auth_section         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.auth_type            = password {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.cafile               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.certfile             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.collect_timing       = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.connect_retries      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.connect_retry_delay  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.default_domain_id    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.default_domain_name  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.domain_id            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.domain_name          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.endpoint_override    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.insecure             = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.keyfile              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.max_version          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.min_version          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.password             = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.project_domain_id    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.project_domain_name  = Default {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.project_id           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.project_name         = service {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.region_name          = RegionOne {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.service_name         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.service_type         = placement {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.split_loggers        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.status_code_retries  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.system_scope         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.timeout              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.trust_id             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.user_domain_id       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.user_domain_name     = Default {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.user_id              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.username             = placement {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] placement.version              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.cores                    = 20 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.count_usage_from_placement = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.injected_file_content_bytes = 10240 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.injected_file_path_length = 255 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.injected_files           = 5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.instances                = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.key_pairs                = 100 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.metadata_items           = 128 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.ram                      = 51200 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.recheck_quota            = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.server_group_members     = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] quota.server_groups            = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rdp.enabled                    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.image_metadata_prefilter = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.max_attempts         = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.max_placement_results = 1000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.query_placement_for_image_type_support = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] scheduler.workers              = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.host_subset_size = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.isolated_hosts = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.isolated_images = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.pci_in_placement = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.track_instance_changes = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metrics.required               = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metrics.weight_multiplier      = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] metrics.weight_setting         = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] serial_console.enabled         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] serial_console.port_range      = 10000:20000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] serial_console.serialproxy_port = 6083 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.auth_section      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.auth_type         = password {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.cafile            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.certfile          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.collect_timing    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.insecure          = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.keyfile           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.send_service_user_token = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.split_loggers     = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] service_user.timeout           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.agent_enabled            = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.enabled                  = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.html5proxy_port          = 6082 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.image_compression        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.jpeg_compression         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.playback_compression     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.server_listen            = 127.0.0.1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.streaming_mode           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] spice.zlib_compression         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] upgrade_levels.baseapi         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] upgrade_levels.cert            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] upgrade_levels.compute         = auto {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] upgrade_levels.conductor       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] upgrade_levels.scheduler       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.auth_section = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.auth_type = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.cafile = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.certfile = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.insecure = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.keyfile = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vendordata_dynamic_auth.timeout = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.api_retry_count         = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.ca_file                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.cache_prefix            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.cluster_name            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.connection_pool_size    = 10 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.console_delay_seconds   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.datastore_regex         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.host_ip                 = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.host_password           = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.host_port               = 443 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.host_username           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.insecure                = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.integration_bridge      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.maximum_objects         = 100 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.pbm_default_policy      = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.pbm_enabled             = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.pbm_wsdl_location       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.serial_port_proxy_uri   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.serial_port_service_uri = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.task_poll_interval      = 0.5 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.use_linked_clone        = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.vnc_keymap              = en-us {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.vnc_port                = 5900 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vmware.vnc_port_total          = 10000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.auth_schemes               = ['none'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.enabled                    = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.novncproxy_port            = 6080 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.server_listen              = 0.0.0.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.vencrypt_ca_certs          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.vencrypt_client_cert       = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vnc.vencrypt_client_key        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.disable_rootwrap   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.enable_numa_live_migration = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.libvirt_disable_apic = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.client_socket_timeout     = 900 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.default_pool_size         = 1000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.keep_alive                = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.max_header_line           = 16384 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.ssl_ca_file               = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.ssl_cert_file             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.ssl_key_file              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.tcp_keepidle              = 600 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] zvm.ca_file                    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] zvm.cloud_connector_url        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] zvm.reachable_timeout          = 300 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.enforce_new_defaults = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.enforce_scope      = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.policy_default_rule = default {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.policy_file        = policy.yaml {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.connection_string     = messaging:// {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.enabled               = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.es_doc_type           = notification {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.es_scroll_size        = 10000 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.es_scroll_time        = 2m {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.filter_error_trace    = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.hmac_keys             = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.sentinel_service_name = mymaster {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.socket_timeout        = 0.1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.trace_requests        = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler.trace_sqlalchemy      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler_jaeger.process_tags   = {} {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler_jaeger.service_name_prefix = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] profiler_otlp.service_name_prefix = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] remote_debug.host              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] remote_debug.port              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.ssl      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_notifications.retry = -1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_messaging_notifications.transport_url = **** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.auth_section        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.auth_type           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.cafile              = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.certfile            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.collect_timing      = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.connect_retries     = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.connect_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.endpoint_id         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.endpoint_override   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.insecure            = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.keyfile             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.max_version         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.min_version         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.region_name         = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.service_name        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.service_type        = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.split_loggers       = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.status_code_retries = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.status_code_retry_delay = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.timeout             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.valid_interfaces    = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_limit.version             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_reports.file_event_handler = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] oslo_reports.log_dir           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_ovs_privileged.group  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] vif_plug_ovs_privileged.user   = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.flat_interface = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.isolate_vif         = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_vif_ovs.per_port_bridge     = False {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] os_brick.lock_path             = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] privsep_osbrick.capabilities   = [21] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] privsep_osbrick.group          = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] privsep_osbrick.helper_command = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] privsep_osbrick.user           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] nova_sys_admin.group           = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] nova_sys_admin.helper_command  = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] nova_sys_admin.user            = None {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG oslo_service.service [None req-27d2da82-1a62-4ab6-9c8a-4c8e64c576ac None None] ******************************************************************************** {{(pid=75354) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 06:25:26 user nova-compute[75354]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Connecting to libvirt: qemu:///system {{(pid=75354) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f809884b520> {{(pid=75354) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 06:25:26 user nova-compute[75354]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 06:25:26 user nova-compute[75354]: WARNING nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f809884b520> {{(pid=75354) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Starting native event thread {{(pid=75354) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Starting green dispatch thread {{(pid=75354) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Starting connection event dispatch thread {{(pid=75354) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 06:25:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Connection event '1' reason 'None'
Nov 14 06:25:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 06:25:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.mount [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Initialising _HostMountState generation 0 {{(pid=75354) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 06:25:34 user nova-compute[75354]: INFO nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host capabilities <capabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <host>
Nov 14 06:25:34 user nova-compute[75354]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 06:25:34 user nova-compute[75354]:     <cpu>
Nov 14 06:25:34 user nova-compute[75354]:       <arch>x86_64</arch>
Nov 14 06:25:34 user nova-compute[75354]:       <model>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <microcode version='1070'/>
Nov 14 06:25:34 user nova-compute[75354]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='osxsave'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='invtsc'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='rsba'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 06:25:34 user nova-compute[75354]:       <pages unit='KiB' size='4'/>
Nov 14 06:25:34 user nova-compute[75354]:       <pages unit='KiB' size='2048'/>
Nov 14 06:25:34 user nova-compute[75354]:     </cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <power_management>
Nov 14 06:25:34 user nova-compute[75354]:       <suspend_mem/>
Nov 14 06:25:34 user nova-compute[75354]:       <suspend_disk/>
Nov 14 06:25:34 user nova-compute[75354]:       <suspend_hybrid/>
Nov 14 06:25:34 user nova-compute[75354]:     </power_management>
Nov 14 06:25:34 user nova-compute[75354]:     <iommu support='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <migration_features>
Nov 14 06:25:34 user nova-compute[75354]:       <live/>
Nov 14 06:25:34 user nova-compute[75354]:       <uri_transports>
Nov 14 06:25:34 user nova-compute[75354]:         <uri_transport>tcp</uri_transport>
Nov 14 06:25:34 user nova-compute[75354]:         <uri_transport>rdma</uri_transport>
Nov 14 06:25:34 user nova-compute[75354]:       </uri_transports>
Nov 14 06:25:34 user nova-compute[75354]:     </migration_features>
Nov 14 06:25:34 user nova-compute[75354]:     <topology>
Nov 14 06:25:34 user nova-compute[75354]:       <cells num='2'>
Nov 14 06:25:34 user nova-compute[75354]:         <cell id='0'>
Nov 14 06:25:34 user nova-compute[75354]:           <memory unit='KiB'>8189224</memory>
Nov 14 06:25:34 user nova-compute[75354]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 06:25:34 user nova-compute[75354]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 06:25:34 user nova-compute[75354]:           <distances>
Nov 14 06:25:34 user nova-compute[75354]:             <sibling id='0' value='10'/>
Nov 14 06:25:34 user nova-compute[75354]:             <sibling id='1' value='20'/>
Nov 14 06:25:34 user nova-compute[75354]:           </distances>
Nov 14 06:25:34 user nova-compute[75354]:           <cpus num='6'>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 06:25:34 user nova-compute[75354]:           </cpus>
Nov 14 06:25:34 user nova-compute[75354]:         </cell>
Nov 14 06:25:34 user nova-compute[75354]:         <cell id='1'>
Nov 14 06:25:34 user nova-compute[75354]:           <memory unit='KiB'>8206460</memory>
Nov 14 06:25:34 user nova-compute[75354]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 06:25:34 user nova-compute[75354]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 06:25:34 user nova-compute[75354]:           <distances>
Nov 14 06:25:34 user nova-compute[75354]:             <sibling id='0' value='20'/>
Nov 14 06:25:34 user nova-compute[75354]:             <sibling id='1' value='10'/>
Nov 14 06:25:34 user nova-compute[75354]:           </distances>
Nov 14 06:25:34 user nova-compute[75354]:           <cpus num='6'>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 06:25:34 user nova-compute[75354]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 06:25:34 user nova-compute[75354]:           </cpus>
Nov 14 06:25:34 user nova-compute[75354]:         </cell>
Nov 14 06:25:34 user nova-compute[75354]:       </cells>
Nov 14 06:25:34 user nova-compute[75354]:     </topology>
Nov 14 06:25:34 user nova-compute[75354]:     <cache>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 06:25:34 user nova-compute[75354]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 06:25:34 user nova-compute[75354]:     </cache>
Nov 14 06:25:34 user nova-compute[75354]:     <secmodel>
Nov 14 06:25:34 user nova-compute[75354]:       <model>apparmor</model>
Nov 14 06:25:34 user nova-compute[75354]:       <doi>0</doi>
Nov 14 06:25:34 user nova-compute[75354]:     </secmodel>
Nov 14 06:25:34 user nova-compute[75354]:     <secmodel>
Nov 14 06:25:34 user nova-compute[75354]:       <model>dac</model>
Nov 14 06:25:34 user nova-compute[75354]:       <doi>0</doi>
Nov 14 06:25:34 user nova-compute[75354]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 06:25:34 user nova-compute[75354]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 06:25:34 user nova-compute[75354]:     </secmodel>
Nov 14 06:25:34 user nova-compute[75354]:   </host>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='alpha'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>clipper</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='armv6l'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>spitz</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>nuri</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>kzm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sx1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>z2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>tosa</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>n810</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>n800</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>terrier</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>midway</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>microbit</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>verdex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>highbank</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>akita</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>connex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>collie</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='armv7l'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>spitz</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>nuri</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>kzm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sx1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>z2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>tosa</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>n810</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>n800</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>terrier</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>midway</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>microbit</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>verdex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>highbank</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>akita</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>connex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>collie</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='aarch64'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>spitz</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>nuri</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>kzm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sx1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>z2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>tosa</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>n810</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>n800</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>terrier</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>midway</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>microbit</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>verdex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>highbank</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>akita</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>connex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>collie</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <acpi default='on' toggle='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='cris'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='i686'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>isapc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>microvm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='kvm'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <pae/>
Nov 14 06:25:34 user nova-compute[75354]:       <nonpae/>
Nov 14 06:25:34 user nova-compute[75354]:       <acpi default='on' toggle='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:       <apic default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='m68k'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>an5206</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>q800</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='microblaze'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='microblazeel'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='mips'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='16'>malta</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='mipsel'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='16'>malta</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='mips64'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='16'>malta</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>pica61</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>magnum</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='mips64el'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='16'>malta</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>pica61</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>magnum</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='16'>boston</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='ppc'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mac99</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>40p</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>taihu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='ppc64'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>taihu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>40p</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mac99</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='ppc64le'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>taihu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>40p</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>mac99</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='riscv32'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='8'>spike</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='8'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='riscv64'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='8'>spike</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='8'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='s390x'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='sh4'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>shix</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>r2d</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='sh4eb'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>shix</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>r2d</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='sparc'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>LX</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='sparc64'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>niagara</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='x86_64'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>64</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='1'>isapc</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>microvm</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='kvm'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <acpi default='on' toggle='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:       <apic default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='xtensa'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>sim</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>kc705</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ml605</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx200</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx60</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]:   <guest>
Nov 14 06:25:34 user nova-compute[75354]:     <os_type>hvm</os_type>
Nov 14 06:25:34 user nova-compute[75354]:     <arch name='xtensaeb'>
Nov 14 06:25:34 user nova-compute[75354]:       <wordsize>32</wordsize>
Nov 14 06:25:34 user nova-compute[75354]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='4'>sim</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>kc705</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ml605</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>virt</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx200</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>lx60</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 06:25:34 user nova-compute[75354]:       <domain type='qemu'/>
Nov 14 06:25:34 user nova-compute[75354]:     </arch>
Nov 14 06:25:34 user nova-compute[75354]:     <features>
Nov 14 06:25:34 user nova-compute[75354]:       <cpuselection/>
Nov 14 06:25:34 user nova-compute[75354]:       <deviceboot/>
Nov 14 06:25:34 user nova-compute[75354]:       <disksnapshot default='on' toggle='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     </features>
Nov 14 06:25:34 user nova-compute[75354]:   </guest>
Nov 14 06:25:34 user nova-compute[75354]: </capabilities>
Nov 14 06:25:34 user nova-compute[75354]: 
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-q35-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>i686</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='288'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'/>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='lm'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-q35-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>i686</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='288'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'/>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='lm'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-i440fx-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>i686</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='255'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'/>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='lm'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ide</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-i440fx-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>i686</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='255'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'/>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='lm'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ide</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-q35-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>x86_64</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='288'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>efi</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='invtsc'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='rsba'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-q35-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>x86_64</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='288'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>efi</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='invtsc'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='rsba'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-i440fx-6.2</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>x86_64</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='255'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>efi</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='invtsc'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='rsba'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ide</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 06:25:34 user nova-compute[75354]: <domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 06:25:34 user nova-compute[75354]:   <domain>kvm</domain>
Nov 14 06:25:34 user nova-compute[75354]:   <machine>pc-i440fx-jammy</machine>
Nov 14 06:25:34 user nova-compute[75354]:   <arch>x86_64</arch>
Nov 14 06:25:34 user nova-compute[75354]:   <vcpu max='255'/>
Nov 14 06:25:34 user nova-compute[75354]:   <iothreads supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:   <os supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='firmware'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>efi</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:     <loader supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>rom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pflash</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='readonly'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>yes</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='secure'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>no</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </loader>
Nov 14 06:25:34 user nova-compute[75354]:   </os>
Nov 14 06:25:34 user nova-compute[75354]:   <cpu>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-passthrough' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='hostPassthroughMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='maximum' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='maximumMigratable'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>on</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>off</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='host-model' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <vendor>Intel</vendor>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ss'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='vmx'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pcid'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='hypervisor'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arat'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='umip'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='md-clear'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='invtsc'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibpb'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='ibrs'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-stibp'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='rsba'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='erms'/>
Nov 14 06:25:34 user nova-compute[75354]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:     <mode name='custom' supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>qemu64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>qemu32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>phenom</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>pentium</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>n270</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm64</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>kvm32</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>coreduo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>core2duo</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>athlon</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Westmere</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Snowridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Skylake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>SandyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Penryn</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G5</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G4</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G3</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Opteron_G2</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Opteron_G1</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>IvyBridge</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Icelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Haswell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Rome</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-Milan</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>EPYC</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Dhyana</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cooperlake</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>Conroe</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='no'>Broadwell</model>
Nov 14 06:25:34 user nova-compute[75354]:       <model usable='yes'>486</model>
Nov 14 06:25:34 user nova-compute[75354]:     </mode>
Nov 14 06:25:34 user nova-compute[75354]:   </cpu>
Nov 14 06:25:34 user nova-compute[75354]:   <memoryBacking supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:     <enum name='sourceType'>
Nov 14 06:25:34 user nova-compute[75354]:       <value>file</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>anonymous</value>
Nov 14 06:25:34 user nova-compute[75354]:       <value>memfd</value>
Nov 14 06:25:34 user nova-compute[75354]:     </enum>
Nov 14 06:25:34 user nova-compute[75354]:   </memoryBacking>
Nov 14 06:25:34 user nova-compute[75354]:   <devices>
Nov 14 06:25:34 user nova-compute[75354]:     <disk supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='diskDevice'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>disk</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cdrom</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>floppy</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>lun</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='bus'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ide</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>fdc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sata</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </disk>
Nov 14 06:25:34 user nova-compute[75354]:     <graphics supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='type'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>sdl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vnc</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>spice</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egl-headless</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </graphics>
Nov 14 06:25:34 user nova-compute[75354]:     <video supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='modelType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>cirrus</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>vmvga</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>qxl</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>none</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>bochs</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>ramfb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </video>
Nov 14 06:25:34 user nova-compute[75354]:     <hostdev supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='mode'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>subsystem</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='startupPolicy'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>default</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>mandatory</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>requisite</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>optional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='subsysType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>usb</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>pci</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>scsi</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='capsType'/>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='pciBackend'/>
Nov 14 06:25:34 user nova-compute[75354]:     </hostdev>
Nov 14 06:25:34 user nova-compute[75354]:     <rng supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtio-non-transitional</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>random</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>egd</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>builtin</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </rng>
Nov 14 06:25:34 user nova-compute[75354]:     <filesystem supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='driverType'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>path</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>handle</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>virtiofs</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </filesystem>
Nov 14 06:25:34 user nova-compute[75354]:     <tpm supported='yes'>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='model'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-tis</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>tpm-crb</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:       <enum name='backendModel'>
Nov 14 06:25:34 user nova-compute[75354]:         <value>passthrough</value>
Nov 14 06:25:34 user nova-compute[75354]:         <value>emulator</value>
Nov 14 06:25:34 user nova-compute[75354]:       </enum>
Nov 14 06:25:34 user nova-compute[75354]:     </tpm>
Nov 14 06:25:34 user nova-compute[75354]:   </devices>
Nov 14 06:25:34 user nova-compute[75354]:   <features>
Nov 14 06:25:34 user nova-compute[75354]:     <gic supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:     <vmcoreinfo supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <genid supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backingStoreInput supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <backup supported='yes'/>
Nov 14 06:25:34 user nova-compute[75354]:     <sev supported='no'/>
Nov 14 06:25:34 user nova-compute[75354]:   </features>
Nov 14 06:25:34 user nova-compute[75354]: </domainCapabilities>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Checking secure boot support for host arch (x86_64) {{(pid=75354) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 06:25:34 user nova-compute[75354]: INFO nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Secure Boot support detected
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] cpu compare xml: <cpu match="exact">
Nov 14 06:25:34 user nova-compute[75354]:   <model>Nehalem</model>
Nov 14 06:25:34 user nova-compute[75354]: </cpu>
Nov 14 06:25:34 user nova-compute[75354]:  {{(pid=75354) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 06:25:34 user nova-compute[75354]: INFO nova.virt.node [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Generated node identity 639f2b20-6e4a-4044-8740-35d2f7c0a858
Nov 14 06:25:34 user nova-compute[75354]: INFO nova.virt.node [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Wrote node identity 639f2b20-6e4a-4044-8740-35d2f7c0a858 to /opt/stack/data/nova/compute_id
Nov 14 06:25:34 user nova-compute[75354]: WARNING nova.compute.manager [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Compute nodes ['639f2b20-6e4a-4044-8740-35d2f7c0a858'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 06:25:34 user nova-compute[75354]: INFO nova.compute.manager [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 06:25:34 user nova-compute[75354]: WARNING nova.compute.manager [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 06:25:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:25:34 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:25:34 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Hypervisor/Node resource view: name=user free_ram=11044MB free_disk=26.26678466796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:25:34 user nova-compute[75354]: WARNING nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] No compute node record for user:639f2b20-6e4a-4044-8740-35d2f7c0a858: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 639f2b20-6e4a-4044-8740-35d2f7c0a858 could not be found.
Nov 14 06:25:34 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Compute node record created for user:user with uuid: 639f2b20-6e4a-4044-8740-35d2f7c0a858
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:25:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:25:35 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] [req-335cebbd-f3ee-4f53-bf79-632bde7d0c56] Created resource provider record via placement API for resource provider with UUID 639f2b20-6e4a-4044-8740-35d2f7c0a858 and name user.
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75354) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 06:25:35 user nova-compute[75354]: INFO nova.virt.libvirt.host [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] kernel doesn't support AMD SEV
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Libvirt baseline CPU <cpu>
Nov 14 06:25:35 user nova-compute[75354]:   <arch>x86_64</arch>
Nov 14 06:25:35 user nova-compute[75354]:   <model>Nehalem</model>
Nov 14 06:25:35 user nova-compute[75354]:   <vendor>Intel</vendor>
Nov 14 06:25:35 user nova-compute[75354]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 06:25:35 user nova-compute[75354]: </cpu>
Nov 14 06:25:35 user nova-compute[75354]:  {{(pid=75354) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Updated inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Updating resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 generation from 0 to 1 during operation: update_inventory {{(pid=75354) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Updating resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 generation from 1 to 2 during operation: update_traits {{(pid=75354) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.service [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Creating RPC server for service compute {{(pid=75354) start /opt/stack/nova/nova/service.py:182}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.service [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] Join ServiceGroup membership for this service compute {{(pid=75354) start /opt/stack/nova/nova/service.py:199}}
Nov 14 06:25:35 user nova-compute[75354]: DEBUG nova.servicegroup.drivers.db [None req-6b1f2cc9-7f12-4bcf-ab10-196acd6dc3de None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75354) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 06:26:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:26:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:26:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=10386MB free_disk=26.170612335205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:26:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:27:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:27:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:27:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=10364MB free_disk=26.234920501708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:27:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:27:27 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:27:27 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:27:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:27:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:27:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:27:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:28:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:28:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=10352MB free_disk=25.98745346069336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:28:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:28:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:29 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:28:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:28:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:28:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:28:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:28:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:29:27 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:27 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9650MB free_disk=26.015701293945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:29:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:29 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:29:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:29:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:29:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:29:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:29:34 user nova-compute[75354]: INFO nova.compute.claims [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Claim successful on node user
Nov 14 06:29:34 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:29:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:29:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:29:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Creating image(s)
Nov 14 06:29:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:35 user nova-compute[75354]: DEBUG nova.policy [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7678e8df1dc94bb999962858edc7ec5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a152b44325b84778b31a79b9faf1b443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:29:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.part --force-share --output=json" returned: 0 in 0.161s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:36 user nova-compute[75354]: DEBUG nova.virt.images [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] 013c3665-3f76-488b-92b6-f08787e9badf was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:29:36 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:29:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.part /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.part /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.converted" returned: 0 in 0.464s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.259s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:37 user nova-compute[75354]: INFO oslo.privsep.daemon [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc59v3w7v/privsep.sock']
Nov 14 06:29:37 user sudo[84601]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc59v3w7v/privsep.sock
Nov 14 06:29:37 user sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 06:29:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Successfully created port: 307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:29:39 user sudo[84601]: pam_unix(sudo:session): session closed for user root
Nov 14 06:29:39 user nova-compute[75354]: INFO oslo.privsep.daemon [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Spawned new privsep daemon via rootwrap
Nov 14 06:29:39 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 06:29:39 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 06:29:39 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 06:29:39 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84607
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:29:39 user nova-compute[75354]: INFO nova.compute.claims [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Claim successful on node user
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.236s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk 1073741824" returned: 0 in 0.057s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.165s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:29:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Cannot resize image /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Ensure instance console log exists: /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:29:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Creating image(s)
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.policy [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43461d505f5f44d68823f9c9e67f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809549aa1ea440abaef3e4ba37ca414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:29:40 user nova-compute[75354]: INFO nova.compute.claims [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Claim successful on node user
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.165s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Successfully updated port: 307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk 1073741824" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:29:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Cannot resize image /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Ensure instance console log exists: /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.policy [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d4a6f66dcb045c9affbc58c80d940ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23d3709300f4fe58a3c792bf176ab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-changed-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Refreshing instance network info cache due to event network-changed-307913af-8833-4c78-8600-a43bbc913f5a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:29:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Creating image(s)
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "/opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "/opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "/opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.205s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk 1073741824" returned: 0 in 0.052s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance network_info: |[{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Refreshing network info cache for port 307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start _get_guest_xml network_info=[{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:29:42 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:42 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'pci_devices' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.202s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:29:42 user nova-compute[75354]:   <uuid>787b732d-c4cc-4cf1-8069-6a8d0458b3b9</uuid>
Nov 14 06:29:42 user nova-compute[75354]:   <name>instance-00000001</name>
Nov 14 06:29:42 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:29:42 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:29:42 user nova-compute[75354]:   <metadata>
Nov 14 06:29:42 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:29:42 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:29:42 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherB-server-924171002</nova:name>
Nov 14 06:29:42 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:29:42</nova:creationTime>
Nov 14 06:29:42 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:29:42 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:29:42 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:29:42 user nova-compute[75354]:       <nova:owner>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:user uuid="7678e8df1dc94bb999962858edc7ec5f">tempest-ServerActionsTestOtherB-766403064-project-member</nova:user>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:project uuid="a152b44325b84778b31a79b9faf1b443">tempest-ServerActionsTestOtherB-766403064</nova:project>
Nov 14 06:29:42 user nova-compute[75354]:       </nova:owner>
Nov 14 06:29:42 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:29:42 user nova-compute[75354]:       <nova:ports>
Nov 14 06:29:42 user nova-compute[75354]:         <nova:port uuid="307913af-8833-4c78-8600-a43bbc913f5a">
Nov 14 06:29:42 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 06:29:42 user nova-compute[75354]:         </nova:port>
Nov 14 06:29:42 user nova-compute[75354]:       </nova:ports>
Nov 14 06:29:42 user nova-compute[75354]:     </nova:instance>
Nov 14 06:29:42 user nova-compute[75354]:   </metadata>
Nov 14 06:29:42 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:29:42 user nova-compute[75354]:     <system>
Nov 14 06:29:42 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:29:42 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:29:42 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:29:42 user nova-compute[75354]:       <entry name="serial">787b732d-c4cc-4cf1-8069-6a8d0458b3b9</entry>
Nov 14 06:29:42 user nova-compute[75354]:       <entry name="uuid">787b732d-c4cc-4cf1-8069-6a8d0458b3b9</entry>
Nov 14 06:29:42 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:29:42 user nova-compute[75354]:     </system>
Nov 14 06:29:42 user nova-compute[75354]:   </sysinfo>
Nov 14 06:29:42 user nova-compute[75354]:   <os>
Nov 14 06:29:42 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:29:42 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:29:42 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:29:42 user nova-compute[75354]:   </os>
Nov 14 06:29:42 user nova-compute[75354]:   <features>
Nov 14 06:29:42 user nova-compute[75354]:     <acpi/>
Nov 14 06:29:42 user nova-compute[75354]:     <apic/>
Nov 14 06:29:42 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:29:42 user nova-compute[75354]:   </features>
Nov 14 06:29:42 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:29:42 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:29:42 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:29:42 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:29:42 user nova-compute[75354]:   </clock>
Nov 14 06:29:42 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:29:42 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:29:42 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:29:42 user nova-compute[75354]:   </cpu>
Nov 14 06:29:42 user nova-compute[75354]:   <devices>
Nov 14 06:29:42 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:29:42 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:29:42 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk"/>
Nov 14 06:29:42 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:29:42 user nova-compute[75354]:     </disk>
Nov 14 06:29:42 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:29:42 user nova-compute[75354]:       <mac address="fa:16:3e:f8:4e:57"/>
Nov 14 06:29:42 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:29:42 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:29:42 user nova-compute[75354]:       <target dev="tap307913af-88"/>
Nov 14 06:29:42 user nova-compute[75354]:     </interface>
Nov 14 06:29:42 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:29:42 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/console.log" append="off"/>
Nov 14 06:29:42 user nova-compute[75354]:     </serial>
Nov 14 06:29:42 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:29:42 user nova-compute[75354]:     <video>
Nov 14 06:29:42 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:29:42 user nova-compute[75354]:     </video>
Nov 14 06:29:42 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:29:42 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:29:42 user nova-compute[75354]:     </rng>
Nov 14 06:29:42 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:29:42 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:29:42 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:29:42 user nova-compute[75354]:     </memballoon>
Nov 14 06:29:42 user nova-compute[75354]:   </devices>
Nov 14 06:29:42 user nova-compute[75354]: </domain>
Nov 14 06:29:42 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG os_vif [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Created schema index Interface.name {{(pid=75354) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Created schema index Port.name {{(pid=75354) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Created schema index Bridge.name {{(pid=75354) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [POLLOUT] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Cannot resize image /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Ensure instance console log exists: /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29ed5203-f502-5910-8fb8-178af698d47e', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Successfully created port: afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:29:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:29:42 user nova-compute[75354]: INFO oslo.privsep.daemon [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjhfg02gl/privsep.sock']
Nov 14 06:29:42 user sudo[84665]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjhfg02gl/privsep.sock
Nov 14 06:29:42 user sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 06:29:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Successfully created port: edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:29:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:43 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updated VIF entry in instance network info cache for port 307913af-8833-4c78-8600-a43bbc913f5a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:29:43 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:29:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ef5209d-00de-45d7-b0c9-9d96447384bf req-926091ea-e24a-467e-a118-5209db12c775 service nova] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:29:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:44 user sudo[84665]: pam_unix(sudo:session): session closed for user root
Nov 14 06:29:44 user nova-compute[75354]: INFO oslo.privsep.daemon [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Spawned new privsep daemon via rootwrap
Nov 14 06:29:44 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 06:29:44 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 06:29:44 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 06:29:44 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84696
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307913af-88, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap307913af-88, col_values=(('qos', UUID('f062eacc-bf4b-43dd-b537-7d4d98945d03')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap307913af-88, col_values=(('external_ids', {'iface-id': '307913af-8833-4c78-8600-a43bbc913f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4e:57', 'vm-uuid': '787b732d-c4cc-4cf1-8069-6a8d0458b3b9'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:44 user nova-compute[75354]: INFO os_vif [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88')
Nov 14 06:29:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:29:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No VIF found with MAC fa:16:3e:f8:4e:57, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:29:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Successfully updated port: edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:29:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:29:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:29:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-changed-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Refreshing instance network info cache due to event network-changed-edb76634-c756-41ed-ace4-5b82d24b5365. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Successfully updated port: afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "refresh_cache-7df258ce-f627-4b68-afa5-e0d1c8cea375" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquired lock "refresh_cache-7df258ce-f627-4b68-afa5-e0d1c8cea375" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-changed-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Refreshing instance network info cache due to event network-changed-afe8f6bf-7c25-4baa-912f-263ad2c41041. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:29:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] Acquiring lock "refresh_cache-7df258ce-f627-4b68-afa5-e0d1c8cea375" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance network_info: |[{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Refreshing network info cache for port edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start _get_guest_xml network_info=[{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'pci_devices' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:29:47 user nova-compute[75354]:   <uuid>68039fc4-3444-4768-aa9e-ba1cb521b5dd</uuid>
Nov 14 06:29:47 user nova-compute[75354]:   <name>instance-00000002</name>
Nov 14 06:29:47 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:29:47 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:29:47 user nova-compute[75354]:   <metadata>
Nov 14 06:29:47 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:29:47 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:29:47 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeTestJSON-server-124393074</nova:name>
Nov 14 06:29:47 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:29:47</nova:creationTime>
Nov 14 06:29:47 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:29:47 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:29:47 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:29:47 user nova-compute[75354]:       <nova:owner>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:user uuid="43461d505f5f44d68823f9c9e67f1cf4">tempest-AttachVolumeTestJSON-1353209128-project-member</nova:user>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:project uuid="f809549aa1ea440abaef3e4ba37ca414">tempest-AttachVolumeTestJSON-1353209128</nova:project>
Nov 14 06:29:47 user nova-compute[75354]:       </nova:owner>
Nov 14 06:29:47 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:29:47 user nova-compute[75354]:       <nova:ports>
Nov 14 06:29:47 user nova-compute[75354]:         <nova:port uuid="edb76634-c756-41ed-ace4-5b82d24b5365">
Nov 14 06:29:47 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 06:29:47 user nova-compute[75354]:         </nova:port>
Nov 14 06:29:47 user nova-compute[75354]:       </nova:ports>
Nov 14 06:29:47 user nova-compute[75354]:     </nova:instance>
Nov 14 06:29:47 user nova-compute[75354]:   </metadata>
Nov 14 06:29:47 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:29:47 user nova-compute[75354]:     <system>
Nov 14 06:29:47 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:29:47 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:29:47 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:29:47 user nova-compute[75354]:       <entry name="serial">68039fc4-3444-4768-aa9e-ba1cb521b5dd</entry>
Nov 14 06:29:47 user nova-compute[75354]:       <entry name="uuid">68039fc4-3444-4768-aa9e-ba1cb521b5dd</entry>
Nov 14 06:29:47 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:29:47 user nova-compute[75354]:     </system>
Nov 14 06:29:47 user nova-compute[75354]:   </sysinfo>
Nov 14 06:29:47 user nova-compute[75354]:   <os>
Nov 14 06:29:47 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:29:47 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:29:47 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:29:47 user nova-compute[75354]:   </os>
Nov 14 06:29:47 user nova-compute[75354]:   <features>
Nov 14 06:29:47 user nova-compute[75354]:     <acpi/>
Nov 14 06:29:47 user nova-compute[75354]:     <apic/>
Nov 14 06:29:47 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:29:47 user nova-compute[75354]:   </features>
Nov 14 06:29:47 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:29:47 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:29:47 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:29:47 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:29:47 user nova-compute[75354]:   </clock>
Nov 14 06:29:47 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:29:47 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:29:47 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:29:47 user nova-compute[75354]:   </cpu>
Nov 14 06:29:47 user nova-compute[75354]:   <devices>
Nov 14 06:29:47 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:29:47 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:29:47 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk"/>
Nov 14 06:29:47 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:29:47 user nova-compute[75354]:     </disk>
Nov 14 06:29:47 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:29:47 user nova-compute[75354]:       <mac address="fa:16:3e:1b:86:63"/>
Nov 14 06:29:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:29:47 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:29:47 user nova-compute[75354]:       <target dev="tapedb76634-c7"/>
Nov 14 06:29:47 user nova-compute[75354]:     </interface>
Nov 14 06:29:47 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:29:47 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/console.log" append="off"/>
Nov 14 06:29:47 user nova-compute[75354]:     </serial>
Nov 14 06:29:47 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:29:47 user nova-compute[75354]:     <video>
Nov 14 06:29:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:29:47 user nova-compute[75354]:     </video>
Nov 14 06:29:47 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:29:47 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:29:47 user nova-compute[75354]:     </rng>
Nov 14 06:29:47 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:29:47 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:29:47 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:29:47 user nova-compute[75354]:     </memballoon>
Nov 14 06:29:47 user nova-compute[75354]:   </devices>
Nov 14 06:29:47 user nova-compute[75354]: </domain>
Nov 14 06:29:47 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG os_vif [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1d25310-fb52-5551-829a-15ef428fe434', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedb76634-c7, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedb76634-c7, col_values=(('qos', UUID('d7b127e0-598e-4fcb-ae0d-7a8ac5e05f8e')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedb76634-c7, col_values=(('external_ids', {'iface-id': 'edb76634-c756-41ed-ace4-5b82d24b5365', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:86:63', 'vm-uuid': '68039fc4-3444-4768-aa9e-ba1cb521b5dd'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:47 user nova-compute[75354]: INFO os_vif [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7')
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:29:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No VIF found with MAC fa:16:3e:1b:86:63, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:29:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance spawned successfully.
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:48 user nova-compute[75354]: INFO nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Took 12.84 seconds to spawn the instance on the hypervisor.
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updated VIF entry in instance network info cache for port edb76634-c756-41ed-ace4-5b82d24b5365. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-85093b25-1aa7-416c-b028-8bfaefd38dbc req-45c0c961-8eb1-44cd-aa59-945075077e35 service nova] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:29:48 user nova-compute[75354]: INFO nova.compute.manager [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Took 13.83 seconds to build instance.
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cc1d84a5-3202-46e7-a81b-135e6ad561e5 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.060s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Updating instance_info_cache with network_info: [{"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Releasing lock "refresh_cache-7df258ce-f627-4b68-afa5-e0d1c8cea375" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Instance network_info: |[{"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] Acquired lock "refresh_cache-7df258ce-f627-4b68-afa5-e0d1c8cea375" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Refreshing network info cache for port afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Start _get_guest_xml network_info=[{"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:29:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1446161305',display_name='tempest-DeleteServersTestJSON-server-1446161305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1446161305',id=3,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c23d3709300f4fe58a3c792bf176ab30',ramdisk_id='',reservation_id='r-sz7z0qbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-463380467',owner_user_name='tempest-DeleteServersTestJSON-463380467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:41Z,user_data=None,user_id='7d4a6f66dcb045c9affbc58c80d940ce',uuid=7df258ce-f627-4b68-afa5-e0d1c8cea375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Converting VIF {"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.objects.instance [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lazy-loading 'pci_devices' on Instance uuid 7df258ce-f627-4b68-afa5-e0d1c8cea375 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-e329e916-6e4e-4a27-945f-edd6e74c001d req-1b68c256-8740-46f5-9c39-b7b9724540f5 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e329e916-6e4e-4a27-945f-edd6e74c001d req-1b68c256-8740-46f5-9c39-b7b9724540f5 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e329e916-6e4e-4a27-945f-edd6e74c001d req-1b68c256-8740-46f5-9c39-b7b9724540f5 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e329e916-6e4e-4a27-945f-edd6e74c001d req-1b68c256-8740-46f5-9c39-b7b9724540f5 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-e329e916-6e4e-4a27-945f-edd6e74c001d req-1b68c256-8740-46f5-9c39-b7b9724540f5 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:29:48 user nova-compute[75354]: WARNING nova.compute.manager [req-e329e916-6e4e-4a27-945f-edd6e74c001d req-1b68c256-8740-46f5-9c39-b7b9724540f5 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state None.
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:29:48 user nova-compute[75354]:   <uuid>7df258ce-f627-4b68-afa5-e0d1c8cea375</uuid>
Nov 14 06:29:48 user nova-compute[75354]:   <name>instance-00000003</name>
Nov 14 06:29:48 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:29:48 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:29:48 user nova-compute[75354]:   <metadata>
Nov 14 06:29:48 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:29:48 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:29:48 user nova-compute[75354]:       <nova:name>tempest-DeleteServersTestJSON-server-1446161305</nova:name>
Nov 14 06:29:48 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:29:48</nova:creationTime>
Nov 14 06:29:48 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:29:48 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:29:48 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:29:48 user nova-compute[75354]:       <nova:owner>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:user uuid="7d4a6f66dcb045c9affbc58c80d940ce">tempest-DeleteServersTestJSON-463380467-project-member</nova:user>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:project uuid="c23d3709300f4fe58a3c792bf176ab30">tempest-DeleteServersTestJSON-463380467</nova:project>
Nov 14 06:29:48 user nova-compute[75354]:       </nova:owner>
Nov 14 06:29:48 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:29:48 user nova-compute[75354]:       <nova:ports>
Nov 14 06:29:48 user nova-compute[75354]:         <nova:port uuid="afe8f6bf-7c25-4baa-912f-263ad2c41041">
Nov 14 06:29:48 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:29:48 user nova-compute[75354]:         </nova:port>
Nov 14 06:29:48 user nova-compute[75354]:       </nova:ports>
Nov 14 06:29:48 user nova-compute[75354]:     </nova:instance>
Nov 14 06:29:48 user nova-compute[75354]:   </metadata>
Nov 14 06:29:48 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:29:48 user nova-compute[75354]:     <system>
Nov 14 06:29:48 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:29:48 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:29:48 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:29:48 user nova-compute[75354]:       <entry name="serial">7df258ce-f627-4b68-afa5-e0d1c8cea375</entry>
Nov 14 06:29:48 user nova-compute[75354]:       <entry name="uuid">7df258ce-f627-4b68-afa5-e0d1c8cea375</entry>
Nov 14 06:29:48 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:29:48 user nova-compute[75354]:     </system>
Nov 14 06:29:48 user nova-compute[75354]:   </sysinfo>
Nov 14 06:29:48 user nova-compute[75354]:   <os>
Nov 14 06:29:48 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:29:48 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:29:48 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:29:48 user nova-compute[75354]:   </os>
Nov 14 06:29:48 user nova-compute[75354]:   <features>
Nov 14 06:29:48 user nova-compute[75354]:     <acpi/>
Nov 14 06:29:48 user nova-compute[75354]:     <apic/>
Nov 14 06:29:48 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:29:48 user nova-compute[75354]:   </features>
Nov 14 06:29:48 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:29:48 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:29:48 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:29:48 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:29:48 user nova-compute[75354]:   </clock>
Nov 14 06:29:48 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:29:48 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:29:48 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:29:48 user nova-compute[75354]:   </cpu>
Nov 14 06:29:48 user nova-compute[75354]:   <devices>
Nov 14 06:29:48 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:29:48 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:29:48 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk"/>
Nov 14 06:29:48 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:29:48 user nova-compute[75354]:     </disk>
Nov 14 06:29:48 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:29:48 user nova-compute[75354]:       <mac address="fa:16:3e:5a:cd:c6"/>
Nov 14 06:29:48 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:29:48 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:29:48 user nova-compute[75354]:       <target dev="tapafe8f6bf-7c"/>
Nov 14 06:29:48 user nova-compute[75354]:     </interface>
Nov 14 06:29:48 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:29:48 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/console.log" append="off"/>
Nov 14 06:29:48 user nova-compute[75354]:     </serial>
Nov 14 06:29:48 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:29:48 user nova-compute[75354]:     <video>
Nov 14 06:29:48 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:29:48 user nova-compute[75354]:     </video>
Nov 14 06:29:48 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:29:48 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:29:48 user nova-compute[75354]:     </rng>
Nov 14 06:29:48 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:29:48 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:29:48 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:29:48 user nova-compute[75354]:     </memballoon>
Nov 14 06:29:48 user nova-compute[75354]:   </devices>
Nov 14 06:29:48 user nova-compute[75354]: </domain>
Nov 14 06:29:48 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1446161305',display_name='tempest-DeleteServersTestJSON-server-1446161305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1446161305',id=3,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c23d3709300f4fe58a3c792bf176ab30',ramdisk_id='',reservation_id='r-sz7z0qbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-463380467',owner_user_name='tempest-DeleteServersTestJSON-463380467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:41Z,user_data=None,user_id='7d4a6f66dcb045c9affbc58c80d940ce',uuid=7df258ce-f627-4b68-afa5-e0d1c8cea375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Converting VIF {"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG os_vif [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d1d8c71-f28e-5273-8a38-5bda72780c4a', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafe8f6bf-7c, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafe8f6bf-7c, col_values=(('qos', UUID('912edb57-d672-4bee-8c6a-7c73f9262a0e')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafe8f6bf-7c, col_values=(('external_ids', {'iface-id': 'afe8f6bf-7c25-4baa-912f-263ad2c41041', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:cd:c6', 'vm-uuid': '7df258ce-f627-4b68-afa5-e0d1c8cea375'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:29:48 user nova-compute[75354]: INFO os_vif [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c')
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:29:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] No VIF found with MAC fa:16:3e:5a:cd:c6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:29:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-1847209b-65b2-4812-8a5e-078db7ab4278 req-c8ddcaf3-4a0d-4a30-ac71-bc440dbf7947 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1847209b-65b2-4812-8a5e-078db7ab4278 req-c8ddcaf3-4a0d-4a30-ac71-bc440dbf7947 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1847209b-65b2-4812-8a5e-078db7ab4278 req-c8ddcaf3-4a0d-4a30-ac71-bc440dbf7947 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1847209b-65b2-4812-8a5e-078db7ab4278 req-c8ddcaf3-4a0d-4a30-ac71-bc440dbf7947 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-1847209b-65b2-4812-8a5e-078db7ab4278 req-c8ddcaf3-4a0d-4a30-ac71-bc440dbf7947 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:29:50 user nova-compute[75354]: WARNING nova.compute.manager [req-1847209b-65b2-4812-8a5e-078db7ab4278 req-c8ddcaf3-4a0d-4a30-ac71-bc440dbf7947 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state None.
Nov 14 06:29:50 user nova-compute[75354]: DEBUG nova.network.neutron [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Updated VIF entry in instance network info cache for port afe8f6bf-7c25-4baa-912f-263ad2c41041. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG nova.network.neutron [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Updating instance_info_cache with network_info: [{"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4bc11e31-83d7-4ea5-92a3-683a08e33b18 req-4c8b72d4-44cb-4ac0-aa89-252ee1ce5b50 service nova] Releasing lock "refresh_cache-7df258ce-f627-4b68-afa5-e0d1c8cea375" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:29:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance spawned successfully.
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: INFO nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Took 12.75 seconds to spawn the instance on the hypervisor.
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:29:53 user nova-compute[75354]: INFO nova.compute.manager [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Took 14.06 seconds to build instance.
Nov 14 06:29:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a4e04c9b-f8ae-4788-808f-2505b88868a1 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.216s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:29:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Instance spawned successfully.
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:29:53 user nova-compute[75354]: INFO nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Took 12.06 seconds to spawn the instance on the hypervisor.
Nov 14 06:29:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:29:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:53 user nova-compute[75354]: INFO nova.compute.manager [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Took 13.14 seconds to build instance.
Nov 14 06:29:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-62f1b1ba-d9d3-4d48-8bd5-73264164a8c7 tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.295s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-534174fd-3cb9-4b08-8172-3b6a6e68fc22 req-0b39cfde-bc2c-4fbc-8e42-17ca0f6cc326 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-534174fd-3cb9-4b08-8172-3b6a6e68fc22 req-0b39cfde-bc2c-4fbc-8e42-17ca0f6cc326 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-534174fd-3cb9-4b08-8172-3b6a6e68fc22 req-0b39cfde-bc2c-4fbc-8e42-17ca0f6cc326 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-534174fd-3cb9-4b08-8172-3b6a6e68fc22 req-0b39cfde-bc2c-4fbc-8e42-17ca0f6cc326 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-534174fd-3cb9-4b08-8172-3b6a6e68fc22 req-0b39cfde-bc2c-4fbc-8e42-17ca0f6cc326 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:29:56 user nova-compute[75354]: WARNING nova.compute.manager [req-534174fd-3cb9-4b08-8172-3b6a6e68fc22 req-0b39cfde-bc2c-4fbc-8e42-17ca0f6cc326 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state None.
Nov 14 06:29:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:29:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:29:57 user nova-compute[75354]: INFO nova.compute.claims [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Claim successful on node user
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-66ace525-3e96-4d64-ab7c-d7e0872b023c req-1d3c58d3-bc7d-4d57-bc0a-8f3acb9345f2 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66ace525-3e96-4d64-ab7c-d7e0872b023c req-1d3c58d3-bc7d-4d57-bc0a-8f3acb9345f2 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66ace525-3e96-4d64-ab7c-d7e0872b023c req-1d3c58d3-bc7d-4d57-bc0a-8f3acb9345f2 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66ace525-3e96-4d64-ab7c-d7e0872b023c req-1d3c58d3-bc7d-4d57-bc0a-8f3acb9345f2 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-66ace525-3e96-4d64-ab7c-d7e0872b023c req-1d3c58d3-bc7d-4d57-bc0a-8f3acb9345f2 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:29:58 user nova-compute[75354]: WARNING nova.compute.manager [req-66ace525-3e96-4d64-ab7c-d7e0872b023c req-1d3c58d3-bc7d-4d57-bc0a-8f3acb9345f2 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state None.
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:29:58 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:29:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:29:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:29:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Creating image(s)
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "/opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "/opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "/opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.325s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.289s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG nova.policy [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdace4f11a3f4e95862b8c979e82d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1f7375b4ed4d649edad03899ab4446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk 1073741824" returned: 0 in 0.065s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.229s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:29:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Cannot resize image /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Ensure instance console log exists: /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:00 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Successfully created port: dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:02 user nova-compute[75354]: INFO nova.compute.claims [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Claim successful on node user
Nov 14 06:30:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Successfully updated port: dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquired lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-changed-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Refreshing instance network info cache due to event network-changed-dbfc4596-8f58-48ea-b4b8-b9452493e3c3. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] Acquiring lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.policy [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efbe1f3eb5e2408f9b96751684d1a9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd7e1ce1b45afb4ba9b08e2cbc562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Creating image(s)
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "/opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "/opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "a3d23e64943c65f54f120bf9683521c0b7190509" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "a3d23e64943c65f54f120bf9683521c0b7190509" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.part --force-share --output=json" returned: 0 in 0.253s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG nova.virt.images [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] 6f0e453a-f888-4932-a318-130e5df11192 was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.part /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Successfully created port: 6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:03 user nova-compute[75354]: INFO nova.compute.claims [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Claim successful on node user
Nov 14 06:30:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updating instance_info_cache with network_info: [{"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.part /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.converted" returned: 0 in 0.352s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Releasing lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Instance network_info: |[{"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] Acquired lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Refreshing network info cache for port dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Start _get_guest_xml network_info=[{"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:04 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:04 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268927131',display_name='tempest-VolumesAdminNegativeTest-server-1268927131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268927131',id=4,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGF9RKO05OBECccZ0G2rHDFQJCXUz2b1i+X0bLlUPeRgAO/o/oQ2ylkZ8O3YfL0JLLMaU8pjhMss0rCQnew2p41zXleOKI592AGW7j3Qt/bvVCWuT3hPvwzvxDEsbWmFQ==',key_name='tempest-keypair-2067120629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f1f7375b4ed4d649edad03899ab4446',ramdisk_id='',reservation_id='r-i60esprr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1431300602',owner_user_name='tempest-VolumesAdminNegativeTest-1431300602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdace4f11a3f4e95862b8c979e82d7ab',uuid=b96beb17-09e1-45a2-8699-8657baa034e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converting VIF {"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'pci_devices' on Instance uuid b96beb17-09e1-45a2-8699-8657baa034e8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:04 user nova-compute[75354]:   <uuid>b96beb17-09e1-45a2-8699-8657baa034e8</uuid>
Nov 14 06:30:04 user nova-compute[75354]:   <name>instance-00000004</name>
Nov 14 06:30:04 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:04 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:04 user nova-compute[75354]:   <metadata>
Nov 14 06:30:04 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:04 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:04 user nova-compute[75354]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1268927131</nova:name>
Nov 14 06:30:04 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:04</nova:creationTime>
Nov 14 06:30:04 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:04 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:04 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:04 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:user uuid="fdace4f11a3f4e95862b8c979e82d7ab">tempest-VolumesAdminNegativeTest-1431300602-project-member</nova:user>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:project uuid="7f1f7375b4ed4d649edad03899ab4446">tempest-VolumesAdminNegativeTest-1431300602</nova:project>
Nov 14 06:30:04 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:04 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:30:04 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:04 user nova-compute[75354]:         <nova:port uuid="dbfc4596-8f58-48ea-b4b8-b9452493e3c3">
Nov 14 06:30:04 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 06:30:04 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:04 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:04 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:04 user nova-compute[75354]:   </metadata>
Nov 14 06:30:04 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:04 user nova-compute[75354]:     <system>
Nov 14 06:30:04 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:04 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:04 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:04 user nova-compute[75354]:       <entry name="serial">b96beb17-09e1-45a2-8699-8657baa034e8</entry>
Nov 14 06:30:04 user nova-compute[75354]:       <entry name="uuid">b96beb17-09e1-45a2-8699-8657baa034e8</entry>
Nov 14 06:30:04 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:04 user nova-compute[75354]:     </system>
Nov 14 06:30:04 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:04 user nova-compute[75354]:   <os>
Nov 14 06:30:04 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:04 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:04 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:04 user nova-compute[75354]:   </os>
Nov 14 06:30:04 user nova-compute[75354]:   <features>
Nov 14 06:30:04 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:04 user nova-compute[75354]:     <apic/>
Nov 14 06:30:04 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:04 user nova-compute[75354]:   </features>
Nov 14 06:30:04 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:04 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:04 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:04 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:04 user nova-compute[75354]:   </clock>
Nov 14 06:30:04 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:04 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:04 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:04 user nova-compute[75354]:   </cpu>
Nov 14 06:30:04 user nova-compute[75354]:   <devices>
Nov 14 06:30:04 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:30:04 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:30:04 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk"/>
Nov 14 06:30:04 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:04 user nova-compute[75354]:     </disk>
Nov 14 06:30:04 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:04 user nova-compute[75354]:       <mac address="fa:16:3e:d5:66:2e"/>
Nov 14 06:30:04 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:04 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:04 user nova-compute[75354]:       <target dev="tapdbfc4596-8f"/>
Nov 14 06:30:04 user nova-compute[75354]:     </interface>
Nov 14 06:30:04 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:04 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/console.log" append="off"/>
Nov 14 06:30:04 user nova-compute[75354]:     </serial>
Nov 14 06:30:04 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:04 user nova-compute[75354]:     <video>
Nov 14 06:30:04 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:04 user nova-compute[75354]:     </video>
Nov 14 06:30:04 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:04 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:04 user nova-compute[75354]:     </rng>
Nov 14 06:30:04 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:04 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:04 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:04 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:04 user nova-compute[75354]:   </devices>
Nov 14 06:30:04 user nova-compute[75354]: </domain>
Nov 14 06:30:04 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268927131',display_name='tempest-VolumesAdminNegativeTest-server-1268927131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268927131',id=4,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGF9RKO05OBECccZ0G2rHDFQJCXUz2b1i+X0bLlUPeRgAO/o/oQ2ylkZ8O3YfL0JLLMaU8pjhMss0rCQnew2p41zXleOKI592AGW7j3Qt/bvVCWuT3hPvwzvxDEsbWmFQ==',key_name='tempest-keypair-2067120629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f1f7375b4ed4d649edad03899ab4446',ramdisk_id='',reservation_id='r-i60esprr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1431300602',owner_user_name='tempest-VolumesAdminNegativeTest-1431300602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdace4f11a3f4e95862b8c979e82d7ab',uuid=b96beb17-09e1-45a2-8699-8657baa034e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converting VIF {"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG os_vif [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509.converted --force-share --output=json" returned: 0 in 0.271s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdc4cae4-6870-56db-b4f6-a4f38430110f', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "a3d23e64943c65f54f120bf9683521c0b7190509" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.432s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbfc4596-8f, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbfc4596-8f, col_values=(('qos', UUID('0d682cb9-2016-40c9-9d53-8066669c3e87')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbfc4596-8f, col_values=(('external_ids', {'iface-id': 'dbfc4596-8f58-48ea-b4b8-b9452493e3c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:66:2e', 'vm-uuid': 'b96beb17-09e1-45a2-8699-8657baa034e8'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:04 user nova-compute[75354]: INFO os_vif [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f')
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 --force-share --output=json" returned: 0 in 0.230s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "a3d23e64943c65f54f120bf9683521c0b7190509" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "a3d23e64943c65f54f120bf9683521c0b7190509" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No VIF found with MAC fa:16:3e:d5:66:2e, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Successfully updated port: 6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquired lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-changed-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Refreshing instance network info cache due to event network-changed-6931719e-5eaf-4f1b-b88d-de1896c208fe. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] Acquiring lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.065s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 --force-share --output=json" returned: 0 in 0.281s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509,backing_fmt=raw /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509,backing_fmt=raw /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk 1073741824" returned: 0 in 0.054s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "a3d23e64943c65f54f120bf9683521c0b7190509" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:04 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.policy [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ca6db752d9740d396768a204f73874f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad9cd240eea481eb57ebf0a143f237e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updating instance_info_cache with network_info: [{"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Cannot resize image /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Releasing lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Instance network_info: |[{"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] Acquired lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.neutron [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Refreshing network info cache for port 6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Start _get_guest_xml network_info=[{"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:29:50Z,direct_url=<?>,disk_format='qcow2',id=6f0e453a-f888-4932-a318-130e5df11192,min_disk=0,min_ram=0,name='',owner='e4a7387219f04ea68e914148216cc7e2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:29:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'image_id': '6f0e453a-f888-4932-a318-130e5df11192'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:05 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:05 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Creating image(s)
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:29:50Z,direct_url=<?>,disk_format='qcow2',id=6f0e453a-f888-4932-a318-130e5df11192,min_disk=0,min_ram=0,name='',owner='e4a7387219f04ea68e914148216cc7e2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:29:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1583428592',display_name='tempest-AttachSCSIVolumeTestJSON-server-1583428592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1583428592',id=5,image_ref='6f0e453a-f888-4932-a318-130e5df11192',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi6VRduYc1y1U62T+Gqo+UIBANIGwICeySLOrULBk6nw0eWnpf94ITGfBK3SIhpM3PVji82YkOVFESQ4JE9whbCMUHA/UKiD70uCfpE2tDBg23XfZTvQaVaDGpR5rfjrw==',key_name='tempest-keypair-2045799639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251bd7e1ce1b45afb4ba9b08e2cbc562',ramdisk_id='',reservation_id='r-8q50vs22',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f0e453a-f888-4932-a318-130e5df11192',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1162113736',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1162113736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efbe1f3eb5e2408f9b96751684d1a9a6',uuid=1fc570b9-a592-425d-9c84-b67a7a37e07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Converting VIF {"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc570b9-a592-425d-9c84-b67a7a37e07f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:05 user nova-compute[75354]:   <uuid>1fc570b9-a592-425d-9c84-b67a7a37e07f</uuid>
Nov 14 06:30:05 user nova-compute[75354]:   <name>instance-00000005</name>
Nov 14 06:30:05 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:05 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:05 user nova-compute[75354]:   <metadata>
Nov 14 06:30:05 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:05 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:05 user nova-compute[75354]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1583428592</nova:name>
Nov 14 06:30:05 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:05</nova:creationTime>
Nov 14 06:30:05 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:05 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:05 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:05 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:user uuid="efbe1f3eb5e2408f9b96751684d1a9a6">tempest-AttachSCSIVolumeTestJSON-1162113736-project-member</nova:user>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:project uuid="251bd7e1ce1b45afb4ba9b08e2cbc562">tempest-AttachSCSIVolumeTestJSON-1162113736</nova:project>
Nov 14 06:30:05 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:05 user nova-compute[75354]:       <nova:root type="image" uuid="6f0e453a-f888-4932-a318-130e5df11192"/>
Nov 14 06:30:05 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:05 user nova-compute[75354]:         <nova:port uuid="6931719e-5eaf-4f1b-b88d-de1896c208fe">
Nov 14 06:30:05 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 06:30:05 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:05 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:05 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:05 user nova-compute[75354]:   </metadata>
Nov 14 06:30:05 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:05 user nova-compute[75354]:     <system>
Nov 14 06:30:05 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:05 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:05 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:05 user nova-compute[75354]:       <entry name="serial">1fc570b9-a592-425d-9c84-b67a7a37e07f</entry>
Nov 14 06:30:05 user nova-compute[75354]:       <entry name="uuid">1fc570b9-a592-425d-9c84-b67a7a37e07f</entry>
Nov 14 06:30:05 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:05 user nova-compute[75354]:     </system>
Nov 14 06:30:05 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:05 user nova-compute[75354]:   <os>
Nov 14 06:30:05 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:05 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:05 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:05 user nova-compute[75354]:   </os>
Nov 14 06:30:05 user nova-compute[75354]:   <features>
Nov 14 06:30:05 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:05 user nova-compute[75354]:     <apic/>
Nov 14 06:30:05 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:05 user nova-compute[75354]:   </features>
Nov 14 06:30:05 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:05 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:05 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:05 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:05 user nova-compute[75354]:   </clock>
Nov 14 06:30:05 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:05 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:05 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:05 user nova-compute[75354]:   </cpu>
Nov 14 06:30:05 user nova-compute[75354]:   <devices>
Nov 14 06:30:05 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:30:05 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:30:05 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk"/>
Nov 14 06:30:05 user nova-compute[75354]:       <target dev="sda" bus="scsi"/>
Nov 14 06:30:05 user nova-compute[75354]:       <address type="drive" controller="0" unit="0"/>
Nov 14 06:30:05 user nova-compute[75354]:     </disk>
Nov 14 06:30:05 user nova-compute[75354]:     <disk type="file" device="cdrom">
Nov 14 06:30:05 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 06:30:05 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.config"/>
Nov 14 06:30:05 user nova-compute[75354]:       <target dev="sdb" bus="scsi"/>
Nov 14 06:30:05 user nova-compute[75354]:       <address type="drive" controller="0" unit="1"/>
Nov 14 06:30:05 user nova-compute[75354]:     </disk>
Nov 14 06:30:05 user nova-compute[75354]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 06:30:05 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:05 user nova-compute[75354]:       <mac address="fa:16:3e:19:77:d2"/>
Nov 14 06:30:05 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:05 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:05 user nova-compute[75354]:       <target dev="tap6931719e-5e"/>
Nov 14 06:30:05 user nova-compute[75354]:     </interface>
Nov 14 06:30:05 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:05 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/console.log" append="off"/>
Nov 14 06:30:05 user nova-compute[75354]:     </serial>
Nov 14 06:30:05 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:05 user nova-compute[75354]:     <video>
Nov 14 06:30:05 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:05 user nova-compute[75354]:     </video>
Nov 14 06:30:05 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:05 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:05 user nova-compute[75354]:     </rng>
Nov 14 06:30:05 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:05 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:05 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:05 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:05 user nova-compute[75354]:   </devices>
Nov 14 06:30:05 user nova-compute[75354]: </domain>
Nov 14 06:30:05 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1583428592',display_name='tempest-AttachSCSIVolumeTestJSON-server-1583428592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1583428592',id=5,image_ref='6f0e453a-f888-4932-a318-130e5df11192',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi6VRduYc1y1U62T+Gqo+UIBANIGwICeySLOrULBk6nw0eWnpf94ITGfBK3SIhpM3PVji82YkOVFESQ4JE9whbCMUHA/UKiD70uCfpE2tDBg23XfZTvQaVaDGpR5rfjrw==',key_name='tempest-keypair-2045799639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251bd7e1ce1b45afb4ba9b08e2cbc562',ramdisk_id='',reservation_id='r-8q50vs22',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f0e453a-f888-4932-a318-130e5df11192',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1162113736',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1162113736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efbe1f3eb5e2408f9b96751684d1a9a6',uuid=1fc570b9-a592-425d-9c84-b67a7a37e07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Converting VIF {"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG os_vif [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f26b346f-aad9-5841-beb5-d29601641225', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6931719e-5e, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6931719e-5e, col_values=(('qos', UUID('71f232f9-1a57-4e47-9802-04ce6806fc0b')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6931719e-5e, col_values=(('external_ids', {'iface-id': '6931719e-5eaf-4f1b-b88d-de1896c208fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:77:d2', 'vm-uuid': '1fc570b9-a592-425d-9c84-b67a7a37e07f'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.241s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:05 user nova-compute[75354]: INFO os_vif [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e')
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.neutron [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updated VIF entry in instance network info cache for port dbfc4596-8f58-48ea-b4b8-b9452493e3c3. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.network.neutron [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updating instance_info_cache with network_info: [{"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-585f215c-d903-4106-9aa8-1f620c7e2016 req-f6992633-411e-43e2-9986-8844e302cf83 service nova] Releasing lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No BDM found with device name sda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No VIF found with MAC fa:16:3e:19:77:d2, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Using config drive
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk 1073741824" returned: 0 in 0.069s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.239s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Cannot resize image /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Ensure instance console log exists: /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.network.neutron [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updated VIF entry in instance network info cache for port 6931719e-5eaf-4f1b-b88d-de1896c208fe. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.network.neutron [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updating instance_info_cache with network_info: [{"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a615894c-c48c-4ca1-9abf-90f0db174ab8 req-0df0e67b-28fa-46af-b97c-63fbcc0ff69d service nova] Releasing lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Creating config drive at /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.config
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplzr5q9u4 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Successfully created port: 11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplzr5q9u4" returned: 0 in 0.077s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:07 user nova-compute[75354]: INFO nova.compute.claims [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Claim successful on node user
Nov 14 06:30:07 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Successfully updated port: 11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquired lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-changed-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Refreshing instance network info cache due to event network-changed-11e84908-3332-4724-b02f-2c747cfd3dba. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] Acquiring lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:08 user nova-compute[75354]: INFO nova.virt.block_device [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Booting with volume e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 at /dev/vda
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.policy [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '332071a34d4c44ed8529fe3431ead3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e074784c3da44c8b4c2c97972f1d94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG os_brick.utils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:08 user nova-compute[75354]: INFO oslo.privsep.daemon [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp2tm0qp9m/privsep.sock']
Nov 14 06:30:08 user sudo[85472]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp2tm0qp9m/privsep.sock
Nov 14 06:30:08 user sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Releasing lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Instance network_info: |[{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] Acquired lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.network.neutron [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Refreshing network info cache for port 11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Start _get_guest_xml network_info=[{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:09 user nova-compute[75354]:   <uuid>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</uuid>
Nov 14 06:30:09 user nova-compute[75354]:   <name>instance-00000006</name>
Nov 14 06:30:09 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:09 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:09 user nova-compute[75354]:   <metadata>
Nov 14 06:30:09 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:09 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:09 user nova-compute[75354]:       <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:30:09 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:09</nova:creationTime>
Nov 14 06:30:09 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:09 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:09 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:09 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:30:09 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:09 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:30:09 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:09 user nova-compute[75354]:         <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:30:09 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:30:09 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:09 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:09 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:09 user nova-compute[75354]:   </metadata>
Nov 14 06:30:09 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:09 user nova-compute[75354]:     <system>
Nov 14 06:30:09 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:09 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:09 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:09 user nova-compute[75354]:       <entry name="serial">6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:30:09 user nova-compute[75354]:       <entry name="uuid">6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:30:09 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:09 user nova-compute[75354]:     </system>
Nov 14 06:30:09 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:09 user nova-compute[75354]:   <os>
Nov 14 06:30:09 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:09 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:09 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:09 user nova-compute[75354]:   </os>
Nov 14 06:30:09 user nova-compute[75354]:   <features>
Nov 14 06:30:09 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:09 user nova-compute[75354]:     <apic/>
Nov 14 06:30:09 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:09 user nova-compute[75354]:   </features>
Nov 14 06:30:09 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:09 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:09 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:09 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:09 user nova-compute[75354]:   </clock>
Nov 14 06:30:09 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:09 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:09 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:09 user nova-compute[75354]:   </cpu>
Nov 14 06:30:09 user nova-compute[75354]:   <devices>
Nov 14 06:30:09 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:30:09 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:30:09 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk"/>
Nov 14 06:30:09 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:09 user nova-compute[75354]:     </disk>
Nov 14 06:30:09 user nova-compute[75354]:     <disk type="file" device="cdrom">
Nov 14 06:30:09 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 06:30:09 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config"/>
Nov 14 06:30:09 user nova-compute[75354]:       <target dev="hda" bus="ide"/>
Nov 14 06:30:09 user nova-compute[75354]:     </disk>
Nov 14 06:30:09 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:09 user nova-compute[75354]:       <mac address="fa:16:3e:43:a3:7d"/>
Nov 14 06:30:09 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:09 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:09 user nova-compute[75354]:       <target dev="tap11e84908-33"/>
Nov 14 06:30:09 user nova-compute[75354]:     </interface>
Nov 14 06:30:09 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:09 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log" append="off"/>
Nov 14 06:30:09 user nova-compute[75354]:     </serial>
Nov 14 06:30:09 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:09 user nova-compute[75354]:     <video>
Nov 14 06:30:09 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:09 user nova-compute[75354]:     </video>
Nov 14 06:30:09 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:09 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:09 user nova-compute[75354]:     </rng>
Nov 14 06:30:09 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:09 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:09 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:09 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:09 user nova-compute[75354]:   </devices>
Nov 14 06:30:09 user nova-compute[75354]: </domain>
Nov 14 06:30:09 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG os_vif [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '633013d7-7ac4-5682-8176-af5ce1b911a3', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11e84908-33, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11e84908-33, col_values=(('qos', UUID('42b88288-f268-444f-9fdd-112e8f076edd')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11e84908-33, col_values=(('external_ids', {'iface-id': '11e84908-3332-4724-b02f-2c747cfd3dba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:a3:7d', 'vm-uuid': '6b2df786-b4e7-4593-b73b-4ee8d54f92e6'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: INFO os_vif [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33')
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Instance spawned successfully.
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No BDM found with device name hda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No VIF found with MAC fa:16:3e:43:a3:7d, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Using config drive
Nov 14 06:30:09 user nova-compute[75354]: INFO nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Took 10.43 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:09 user nova-compute[75354]: INFO nova.compute.manager [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Took 12.25 seconds to build instance.
Nov 14 06:30:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7753dc7d-9b8f-44c4-956e-373461011a43 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.702s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Creating config drive at /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config
Nov 14 06:30:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpev7g6ta0 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpev7g6ta0" returned: 0 in 0.086s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG nova.network.neutron [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updated VIF entry in instance network info cache for port 11e84908-3332-4724-b02f-2c747cfd3dba. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG nova.network.neutron [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5612cce3-2bd9-4e91-b243-22c941764032 req-66645974-e08f-4c08-a0c1-c2dff60b1f2b service nova] Releasing lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:10 user sudo[85472]: pam_unix(sudo:session): session closed for user root
Nov 14 06:30:10 user nova-compute[75354]: INFO oslo.privsep.daemon [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Spawned new privsep daemon via rootwrap
Nov 14 06:30:10 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 06:30:10 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 06:30:10 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 06:30:10 user nova-compute[75354]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85546
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2dc49d-e393-492d-ba82-f2d7b3701890]: (2,) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Successfully created port: 906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a60fe-1a59-4724-b499-b35b2788da7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:10 user nova-compute[75354]: WARNING os_brick.initiator.connectors.nvmeof [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[486737b9-67c4-4710-81d3-1d1df36ab8d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5eb7c-ac59-434a-8217-1a795f930d09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7123a35d-1751-43bd-bfa8-242dd4934359]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:10 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f2ae3d-5f7d-406d-972c-305d7c62bf78]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG os_brick.utils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== get_connector_properties: return (2274ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:10 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating existing volume attachment record: 9a8b8b51-9f71-4c2f-8f81-c9314f1ce7e4 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Instance spawned successfully.
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:11 user nova-compute[75354]: INFO nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Took 8.66 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:11 user nova-compute[75354]: INFO nova.compute.manager [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Took 9.74 seconds to build instance.
Nov 14 06:30:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b8f6de22-020e-4de2-9536-921faa84a076 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.910s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-e902ef50-4155-4b71-9143-339793f3035e req-eacad2d1-1e57-4529-a9b1-56303f2fa697 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e902ef50-4155-4b71-9143-339793f3035e req-eacad2d1-1e57-4529-a9b1-56303f2fa697 service nova] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e902ef50-4155-4b71-9143-339793f3035e req-eacad2d1-1e57-4529-a9b1-56303f2fa697 service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e902ef50-4155-4b71-9143-339793f3035e req-eacad2d1-1e57-4529-a9b1-56303f2fa697 service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-e902ef50-4155-4b71-9143-339793f3035e req-eacad2d1-1e57-4529-a9b1-56303f2fa697 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] No waiting events found dispatching network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:12 user nova-compute[75354]: WARNING nova.compute.manager [req-e902ef50-4155-4b71-9143-339793f3035e req-eacad2d1-1e57-4529-a9b1-56303f2fa697 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received unexpected event network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 for instance with vm_state active and task_state None.
Nov 14 06:30:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Successfully updated port: 906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquired lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating instance_info_cache with network_info: [{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Releasing lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance network_info: |[{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:13 user nova-compute[75354]: INFO nova.compute.claims [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Claim successful on node user
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Instance spawned successfully.
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-435ba7f3-c1f6-49cd-be1a-dab95414ec7d req-7234f8af-6f4e-479a-bc66-13bcc8ebbccc service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-435ba7f3-c1f6-49cd-be1a-dab95414ec7d req-7234f8af-6f4e-479a-bc66-13bcc8ebbccc service nova] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-435ba7f3-c1f6-49cd-be1a-dab95414ec7d req-7234f8af-6f4e-479a-bc66-13bcc8ebbccc service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-435ba7f3-c1f6-49cd-be1a-dab95414ec7d req-7234f8af-6f4e-479a-bc66-13bcc8ebbccc service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-435ba7f3-c1f6-49cd-be1a-dab95414ec7d req-7234f8af-6f4e-479a-bc66-13bcc8ebbccc service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] No waiting events found dispatching network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:14 user nova-compute[75354]: WARNING nova.compute.manager [req-435ba7f3-c1f6-49cd-be1a-dab95414ec7d req-7234f8af-6f4e-479a-bc66-13bcc8ebbccc service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received unexpected event network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 for instance with vm_state active and task_state None.
Nov 14 06:30:14 user nova-compute[75354]: INFO nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Took 9.10 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.policy [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46afb46ec94745f18b5a7f6a18b3aa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56caa1b81fcd45bab0f82a66c05352ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-changed-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Refreshing instance network info cache due to event network-changed-906df1dc-5f74-42b1-b5bf-97d24850db6f. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] Acquiring lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] Acquired lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.network.neutron [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Refreshing network info cache for port 906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Creating image(s)
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "/opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "/opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "/opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:14 user nova-compute[75354]: INFO nova.compute.manager [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Took 11.09 seconds to build instance.
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c034a36d-6b18-4792-8eca-279911537110 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.216s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.248s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.231s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk 1073741824" returned: 0 in 0.064s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.220s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-46968d4d-70dd-457a-85df-5859aad1cbe0 req-0f755249-947d-4858-87d3-9c2e0600e3ef service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-46968d4d-70dd-457a-85df-5859aad1cbe0 req-0f755249-947d-4858-87d3-9c2e0600e3ef service nova] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-46968d4d-70dd-457a-85df-5859aad1cbe0 req-0f755249-947d-4858-87d3-9c2e0600e3ef service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-46968d4d-70dd-457a-85df-5859aad1cbe0 req-0f755249-947d-4858-87d3-9c2e0600e3ef service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-46968d4d-70dd-457a-85df-5859aad1cbe0 req-0f755249-947d-4858-87d3-9c2e0600e3ef service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] No waiting events found dispatching network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:15 user nova-compute[75354]: WARNING nova.compute.manager [req-46968d4d-70dd-457a-85df-5859aad1cbe0 req-0f755249-947d-4858-87d3-9c2e0600e3ef service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received unexpected event network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe for instance with vm_state active and task_state None.
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updated VIF entry in instance network info cache for port 906df1dc-5f74-42b1-b5bf-97d24850db6f. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating instance_info_cache with network_info: [{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] Releasing lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] No waiting events found dispatching network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:15 user nova-compute[75354]: WARNING nova.compute.manager [req-1bacf007-3012-4970-a0af-b4a8dc843f1d req-ed177109-fc03-44b8-8b65-b2cd4f0b1818 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received unexpected event network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 for instance with vm_state active and task_state None.
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Cannot resize image /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Ensure instance console log exists: /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Successfully created port: 924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-849e93db-8dcd-4610-9c5e-33e94a839465 req-cf18997f-7bd6-4f5f-a198-b3530a189b70 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-849e93db-8dcd-4610-9c5e-33e94a839465 req-cf18997f-7bd6-4f5f-a198-b3530a189b70 service nova] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-849e93db-8dcd-4610-9c5e-33e94a839465 req-cf18997f-7bd6-4f5f-a198-b3530a189b70 service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-849e93db-8dcd-4610-9c5e-33e94a839465 req-cf18997f-7bd6-4f5f-a198-b3530a189b70 service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-849e93db-8dcd-4610-9c5e-33e94a839465 req-cf18997f-7bd6-4f5f-a198-b3530a189b70 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] No waiting events found dispatching network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:16 user nova-compute[75354]: WARNING nova.compute.manager [req-849e93db-8dcd-4610-9c5e-33e94a839465 req-cf18997f-7bd6-4f5f-a198-b3530a189b70 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received unexpected event network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 for instance with vm_state active and task_state None.
Nov 14 06:30:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Creating image(s)
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Ensure instance console log exists: /opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Start _get_guest_xml network_info=[{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93429017-a737-45d4-965b-d7369a440bf8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'serial': 'e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '9a8b8b51-9f71-4c2f-8f81-c9314f1ce7e4', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connector [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Factory for ISCSI on None {{(pid=75354) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:17 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-8fee19de-4c8b-4fbd-9788-48b6cc277fbe req-52cc0e96-66e8-4875-ba8e-ea92b2a0f48d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8fee19de-4c8b-4fbd-9788-48b6cc277fbe req-52cc0e96-66e8-4875-ba8e-ea92b2a0f48d service nova] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8fee19de-4c8b-4fbd-9788-48b6cc277fbe req-52cc0e96-66e8-4875-ba8e-ea92b2a0f48d service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8fee19de-4c8b-4fbd-9788-48b6cc277fbe req-52cc0e96-66e8-4875-ba8e-ea92b2a0f48d service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-8fee19de-4c8b-4fbd-9788-48b6cc277fbe req-52cc0e96-66e8-4875-ba8e-ea92b2a0f48d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] No waiting events found dispatching network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:17 user nova-compute[75354]: WARNING nova.compute.manager [req-8fee19de-4c8b-4fbd-9788-48b6cc277fbe req-52cc0e96-66e8-4875-ba8e-ea92b2a0f48d service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received unexpected event network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe for instance with vm_state active and task_state None.
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a87fb3b-9ce5-4faa-b9a6-e621a36c5008]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:17 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f211609-6961-4966-b729-c3aa1fbba265]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1] added
Nov 14 06:30:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[656373a5-141c-4c10-a65b-148cc45c0912]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2f77a4-fa65-4b6d-b8dd-d0600b0da7e6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZCALYJQ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZCALYJQ" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e69d1-50d3-47c7-a58b-0c3ccd384e52]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZCALYJQ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f6e67-7f78-4821-82a1-31c942addd1d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eecdd0-4a3e-4c57-bdec-859fbea398bc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 06:30:17 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 06:30:17 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 06:30:17 user nova-compute[75354]: 
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc8b10-c988-45e9-b0e5-0cb845559cb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]
Nov 14 06:30:17 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54303472-1704-44e0-bb2e-9a9cc6f77387]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58153fcf-43bb-44ca-b94b-e9025989d3fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[884414af-39a4-43bf-a1ef-c948abbcf10b]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Successfully updated port: 924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquired lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-changed-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Refreshing instance network info cache due to event network-changed-924b8fb4-50d6-4ec2-a462-8395186b525a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] Acquiring lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updating instance_info_cache with network_info: [{"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26461613033323332', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461613033323332', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Releasing lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Instance network_info: |[{"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] Acquired lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.neutron [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Refreshing network info cache for port 924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Start _get_guest_xml network_info=[{"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2097679557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2097679557',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+U3sLOre+F5aoiCDKzHyv9ZTfTl812MaliLoYlPWTQ62vXFOp6v+jH/QM0j4JEuXeCOVF2NnI+RHNMb3Q/SAd3L0i/qEX0Ssw/kKVMRBXrQMIpN0cAzNOwCP4hnqSaA==',key_name='tempest-keypair-1519457139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e074784c3da44c8b4c2c97972f1d94b',ramdisk_id='',reservation_id='r-brr8bk9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2126097574',owner_user_name='tempest-ServerActionsV293TestJSON-2126097574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='332071a34d4c44ed8529fe3431ead3c1',uuid=93429017-a737-45d4-965b-d7369a440bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converting VIF {"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lazy-loading 'pci_devices' on Instance uuid 93429017-a737-45d4-965b-d7369a440bf8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1293286',id=8,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/qWvQ0ETh8J1EmSu2VQClnifiUHIPfkAkgJ4iYM7I5bZUTbiA2F620RzkYHtAHrG0L4sJNGTfBFDzIq+FJSb9RfJOnTvYWluKVxJTbk1JS2SQIy4rd4PQTL+qGbaEdg==',key_name='tempest-keypair-1561745228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56caa1b81fcd45bab0f82a66c05352ff',ramdisk_id='',reservation_id='r-8thhowdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1481112930',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46afb46ec94745f18b5a7f6a18b3aa63',uuid=9677bd15-7e09-41db-8f75-0da15ac5d426,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Converting VIF {"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lazy-loading 'pci_devices' on Instance uuid 9677bd15-7e09-41db-8f75-0da15ac5d426 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:18 user nova-compute[75354]:   <uuid>93429017-a737-45d4-965b-d7369a440bf8</uuid>
Nov 14 06:30:18 user nova-compute[75354]:   <name>instance-00000007</name>
Nov 14 06:30:18 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:18 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:18 user nova-compute[75354]:   <metadata>
Nov 14 06:30:18 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:18 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2097679557</nova:name>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:17</nova:creationTime>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:18 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:18 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:user uuid="332071a34d4c44ed8529fe3431ead3c1">tempest-ServerActionsV293TestJSON-2126097574-project-member</nova:user>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:project uuid="3e074784c3da44c8b4c2c97972f1d94b">tempest-ServerActionsV293TestJSON-2126097574</nova:project>
Nov 14 06:30:18 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:port uuid="906df1dc-5f74-42b1-b5bf-97d24850db6f">
Nov 14 06:30:18 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:30:18 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:18 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:18 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:18 user nova-compute[75354]:   </metadata>
Nov 14 06:30:18 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:18 user nova-compute[75354]:     <system>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="serial">93429017-a737-45d4-965b-d7369a440bf8</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="uuid">93429017-a737-45d4-965b-d7369a440bf8</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:18 user nova-compute[75354]:     </system>
Nov 14 06:30:18 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:18 user nova-compute[75354]:   <os>
Nov 14 06:30:18 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:18 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:18 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:18 user nova-compute[75354]:   </os>
Nov 14 06:30:18 user nova-compute[75354]:   <features>
Nov 14 06:30:18 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:18 user nova-compute[75354]:     <apic/>
Nov 14 06:30:18 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:18 user nova-compute[75354]:   </features>
Nov 14 06:30:18 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:18 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:18 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:18 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:18 user nova-compute[75354]:   </clock>
Nov 14 06:30:18 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:18 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:18 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:18 user nova-compute[75354]:   </cpu>
Nov 14 06:30:18 user nova-compute[75354]:   <devices>
Nov 14 06:30:18 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:18 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:18 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 06:30:18 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:18 user nova-compute[75354]:       <serial>e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1</serial>
Nov 14 06:30:18 user nova-compute[75354]:     </disk>
Nov 14 06:30:18 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:18 user nova-compute[75354]:       <mac address="fa:16:3e:b7:e1:db"/>
Nov 14 06:30:18 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:18 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:18 user nova-compute[75354]:       <target dev="tap906df1dc-5f"/>
Nov 14 06:30:18 user nova-compute[75354]:     </interface>
Nov 14 06:30:18 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:18 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8/console.log" append="off"/>
Nov 14 06:30:18 user nova-compute[75354]:     </serial>
Nov 14 06:30:18 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:18 user nova-compute[75354]:     <video>
Nov 14 06:30:18 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:18 user nova-compute[75354]:     </video>
Nov 14 06:30:18 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:18 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:18 user nova-compute[75354]:     </rng>
Nov 14 06:30:18 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:18 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:18 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:18 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:18 user nova-compute[75354]:   </devices>
Nov 14 06:30:18 user nova-compute[75354]: </domain>
Nov 14 06:30:18 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2097679557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2097679557',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+U3sLOre+F5aoiCDKzHyv9ZTfTl812MaliLoYlPWTQ62vXFOp6v+jH/QM0j4JEuXeCOVF2NnI+RHNMb3Q/SAd3L0i/qEX0Ssw/kKVMRBXrQMIpN0cAzNOwCP4hnqSaA==',key_name='tempest-keypair-1519457139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e074784c3da44c8b4c2c97972f1d94b',ramdisk_id='',reservation_id='r-brr8bk9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2126097574',owner_user_name='tempest-ServerActionsV293TestJSON-2126097574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='332071a34d4c44ed8529fe3431ead3c1',uuid=93429017-a737-45d4-965b-d7369a440bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converting VIF {"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG os_vif [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99cc3ff9-7706-5950-8961-e55ae63d4781', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:18 user nova-compute[75354]:   <uuid>9677bd15-7e09-41db-8f75-0da15ac5d426</uuid>
Nov 14 06:30:18 user nova-compute[75354]:   <name>instance-00000008</name>
Nov 14 06:30:18 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:18 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:18 user nova-compute[75354]:   <metadata>
Nov 14 06:30:18 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:18 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398</nova:name>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:18</nova:creationTime>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:18 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:18 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:user uuid="46afb46ec94745f18b5a7f6a18b3aa63">tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member</nova:user>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:project uuid="56caa1b81fcd45bab0f82a66c05352ff">tempest-TestServerVolumeAttachScenarioOldVersion-1481112930</nova:project>
Nov 14 06:30:18 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:30:18 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:18 user nova-compute[75354]:         <nova:port uuid="924b8fb4-50d6-4ec2-a462-8395186b525a">
Nov 14 06:30:18 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:30:18 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:18 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:18 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:18 user nova-compute[75354]:   </metadata>
Nov 14 06:30:18 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:18 user nova-compute[75354]:     <system>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="serial">9677bd15-7e09-41db-8f75-0da15ac5d426</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="uuid">9677bd15-7e09-41db-8f75-0da15ac5d426</entry>
Nov 14 06:30:18 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:18 user nova-compute[75354]:     </system>
Nov 14 06:30:18 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:18 user nova-compute[75354]:   <os>
Nov 14 06:30:18 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:18 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:18 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:18 user nova-compute[75354]:   </os>
Nov 14 06:30:18 user nova-compute[75354]:   <features>
Nov 14 06:30:18 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:18 user nova-compute[75354]:     <apic/>
Nov 14 06:30:18 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:18 user nova-compute[75354]:   </features>
Nov 14 06:30:18 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:18 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:18 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:18 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:18 user nova-compute[75354]:   </clock>
Nov 14 06:30:18 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:18 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:18 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:18 user nova-compute[75354]:   </cpu>
Nov 14 06:30:18 user nova-compute[75354]:   <devices>
Nov 14 06:30:18 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:30:18 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:30:18 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk"/>
Nov 14 06:30:18 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:18 user nova-compute[75354]:     </disk>
Nov 14 06:30:18 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:18 user nova-compute[75354]:       <mac address="fa:16:3e:c2:c8:76"/>
Nov 14 06:30:18 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:18 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:18 user nova-compute[75354]:       <target dev="tap924b8fb4-50"/>
Nov 14 06:30:18 user nova-compute[75354]:     </interface>
Nov 14 06:30:18 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:18 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/console.log" append="off"/>
Nov 14 06:30:18 user nova-compute[75354]:     </serial>
Nov 14 06:30:18 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:18 user nova-compute[75354]:     <video>
Nov 14 06:30:18 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:18 user nova-compute[75354]:     </video>
Nov 14 06:30:18 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:18 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:18 user nova-compute[75354]:     </rng>
Nov 14 06:30:18 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:18 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:18 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:18 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:18 user nova-compute[75354]:   </devices>
Nov 14 06:30:18 user nova-compute[75354]: </domain>
Nov 14 06:30:18 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1293286',id=8,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/qWvQ0ETh8J1EmSu2VQClnifiUHIPfkAkgJ4iYM7I5bZUTbiA2F620RzkYHtAHrG0L4sJNGTfBFDzIq+FJSb9RfJOnTvYWluKVxJTbk1JS2SQIy4rd4PQTL+qGbaEdg==',key_name='tempest-keypair-1561745228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56caa1b81fcd45bab0f82a66c05352ff',ramdisk_id='',reservation_id='r-8thhowdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1481112930',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46afb46ec94745f18b5a7f6a18b3aa63',uuid=9677bd15-7e09-41db-8f75-0da15ac5d426,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Converting VIF {"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG os_vif [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c053b06a-00f0-5aa5-96d5-61db595bb66d', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap906df1dc-5f, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap906df1dc-5f, col_values=(('qos', UUID('4627337b-cf6b-4e8a-940d-80a2d480e425')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap906df1dc-5f, col_values=(('external_ids', {'iface-id': '906df1dc-5f74-42b1-b5bf-97d24850db6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:e1:db', 'vm-uuid': '93429017-a737-45d4-965b-d7369a440bf8'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: INFO os_vif [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f')
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap924b8fb4-50, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap924b8fb4-50, col_values=(('qos', UUID('d5a63081-254a-4100-9c83-0fde65341d64')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap924b8fb4-50, col_values=(('external_ids', {'iface-id': '924b8fb4-50d6-4ec2-a462-8395186b525a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:c8:76', 'vm-uuid': '9677bd15-7e09-41db-8f75-0da15ac5d426'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:19 user nova-compute[75354]: INFO os_vif [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50')
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] No VIF found with MAC fa:16:3e:b7:e1:db, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] No VIF found with MAC fa:16:3e:c2:c8:76, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.network.neutron [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updated VIF entry in instance network info cache for port 924b8fb4-50d6-4ec2-a462-8395186b525a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.network.neutron [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updating instance_info_cache with network_info: [{"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b6c4f565-d8ec-4753-b682-7de9c5bd5bcd req-bb4f99a9-f614-49b2-af28-5ae105984cc4 service nova] Releasing lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:19 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:19 user nova-compute[75354]: INFO nova.compute.claims [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Claim successful on node user
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.policy [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab28d1deda014d2195e3cda963729eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa38efc664842d9bcbf971a2d999e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Creating image(s)
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "/opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "/opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.228s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.230s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk 1073741824" returned: 0 in 0.077s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.220s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Successfully created port: de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Cannot resize image /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Ensure instance console log exists: /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-a0d1ce00-4ab8-4d9e-9eae-631de5bdccdf req-58fc1131-f6e3-482f-bc3e-7f62fefed975 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a0d1ce00-4ab8-4d9e-9eae-631de5bdccdf req-58fc1131-f6e3-482f-bc3e-7f62fefed975 service nova] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a0d1ce00-4ab8-4d9e-9eae-631de5bdccdf req-58fc1131-f6e3-482f-bc3e-7f62fefed975 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a0d1ce00-4ab8-4d9e-9eae-631de5bdccdf req-58fc1131-f6e3-482f-bc3e-7f62fefed975 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-a0d1ce00-4ab8-4d9e-9eae-631de5bdccdf req-58fc1131-f6e3-482f-bc3e-7f62fefed975 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] No waiting events found dispatching network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:22 user nova-compute[75354]: WARNING nova.compute.manager [req-a0d1ce00-4ab8-4d9e-9eae-631de5bdccdf req-58fc1131-f6e3-482f-bc3e-7f62fefed975 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received unexpected event network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a for instance with vm_state building and task_state spawning.
Nov 14 06:30:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Successfully updated port: de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquired lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-changed-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Refreshing instance network info cache due to event network-changed-de150d79-f1d1-4f35-9cd8-e7fef54c20c1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] Acquiring lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:22 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updating instance_info_cache with network_info: [{"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Releasing lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Instance network_info: |[{"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] Acquired lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.network.neutron [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Refreshing network info cache for port de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Start _get_guest_xml network_info=[{"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:23 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:23 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1413122735',display_name='tempest-VolumesAssistedSnapshotsTest-server-1413122735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1413122735',id=9,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEndu3huhL7L31cD2w6pr2dkJ/zYBLS8d9g9gukPa20HHSr9aNn8xazNFKnR3MljJqN5JWWd+FOct9lqI+dY4Ub8qoRv3wlp55WM6KMukYDyPu2CIdPPQKBJ5Frr0pEDXQ==',key_name='tempest-keypair-595419698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aa38efc664842d9bcbf971a2d999e26',ramdisk_id='',reservation_id='r-kcsnebht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-247248921',owner_user_name='tempest-VolumesAssistedSnapshotsTest-247248921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab28d1deda014d2195e3cda963729eeb',uuid=3ef09cb8-e642-4810-a2fe-aa4d79c055c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Converting VIF {"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:23 user nova-compute[75354]:   <uuid>3ef09cb8-e642-4810-a2fe-aa4d79c055c4</uuid>
Nov 14 06:30:23 user nova-compute[75354]:   <name>instance-00000009</name>
Nov 14 06:30:23 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:23 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:23 user nova-compute[75354]:   <metadata>
Nov 14 06:30:23 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:23 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:23 user nova-compute[75354]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1413122735</nova:name>
Nov 14 06:30:23 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:23</nova:creationTime>
Nov 14 06:30:23 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:23 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:23 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:23 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:user uuid="ab28d1deda014d2195e3cda963729eeb">tempest-VolumesAssistedSnapshotsTest-247248921-project-member</nova:user>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:project uuid="6aa38efc664842d9bcbf971a2d999e26">tempest-VolumesAssistedSnapshotsTest-247248921</nova:project>
Nov 14 06:30:23 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:23 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:30:23 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:23 user nova-compute[75354]:         <nova:port uuid="de150d79-f1d1-4f35-9cd8-e7fef54c20c1">
Nov 14 06:30:23 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 06:30:23 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:23 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:23 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:23 user nova-compute[75354]:   </metadata>
Nov 14 06:30:23 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:23 user nova-compute[75354]:     <system>
Nov 14 06:30:23 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:23 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:23 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:23 user nova-compute[75354]:       <entry name="serial">3ef09cb8-e642-4810-a2fe-aa4d79c055c4</entry>
Nov 14 06:30:23 user nova-compute[75354]:       <entry name="uuid">3ef09cb8-e642-4810-a2fe-aa4d79c055c4</entry>
Nov 14 06:30:23 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:23 user nova-compute[75354]:     </system>
Nov 14 06:30:23 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:23 user nova-compute[75354]:   <os>
Nov 14 06:30:23 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:23 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:23 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:23 user nova-compute[75354]:   </os>
Nov 14 06:30:23 user nova-compute[75354]:   <features>
Nov 14 06:30:23 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:23 user nova-compute[75354]:     <apic/>
Nov 14 06:30:23 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:23 user nova-compute[75354]:   </features>
Nov 14 06:30:23 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:23 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:23 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:23 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:23 user nova-compute[75354]:   </clock>
Nov 14 06:30:23 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:23 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:23 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:23 user nova-compute[75354]:   </cpu>
Nov 14 06:30:23 user nova-compute[75354]:   <devices>
Nov 14 06:30:23 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:30:23 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:30:23 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk"/>
Nov 14 06:30:23 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:23 user nova-compute[75354]:     </disk>
Nov 14 06:30:23 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:23 user nova-compute[75354]:       <mac address="fa:16:3e:8a:81:de"/>
Nov 14 06:30:23 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:23 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:23 user nova-compute[75354]:       <target dev="tapde150d79-f1"/>
Nov 14 06:30:23 user nova-compute[75354]:     </interface>
Nov 14 06:30:23 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:23 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/console.log" append="off"/>
Nov 14 06:30:23 user nova-compute[75354]:     </serial>
Nov 14 06:30:23 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:23 user nova-compute[75354]:     <video>
Nov 14 06:30:23 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:23 user nova-compute[75354]:     </video>
Nov 14 06:30:23 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:23 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:23 user nova-compute[75354]:     </rng>
Nov 14 06:30:23 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:23 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:23 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:23 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:23 user nova-compute[75354]:   </devices>
Nov 14 06:30:23 user nova-compute[75354]: </domain>
Nov 14 06:30:23 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1413122735',display_name='tempest-VolumesAssistedSnapshotsTest-server-1413122735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1413122735',id=9,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEndu3huhL7L31cD2w6pr2dkJ/zYBLS8d9g9gukPa20HHSr9aNn8xazNFKnR3MljJqN5JWWd+FOct9lqI+dY4Ub8qoRv3wlp55WM6KMukYDyPu2CIdPPQKBJ5Frr0pEDXQ==',key_name='tempest-keypair-595419698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aa38efc664842d9bcbf971a2d999e26',ramdisk_id='',reservation_id='r-kcsnebht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-247248921',owner_user_name='tempest-VolumesAssistedSnapshotsTest-247248921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab28d1deda014d2195e3cda963729eeb',uuid=3ef09cb8-e642-4810-a2fe-aa4d79c055c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Converting VIF {"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG os_vif [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e620b3d2-b40e-50f0-90de-7b4168f8f46d', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde150d79-f1, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde150d79-f1, col_values=(('qos', UUID('2889bf50-80a6-45f2-b6a0-3daf20d71c88')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde150d79-f1, col_values=(('external_ids', {'iface-id': 'de150d79-f1d1-4f35-9cd8-e7fef54c20c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:81:de', 'vm-uuid': '3ef09cb8-e642-4810-a2fe-aa4d79c055c4'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:23 user nova-compute[75354]: INFO os_vif [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1')
Nov 14 06:30:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] No VIF found with MAC fa:16:3e:8a:81:de, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG nova.network.neutron [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updated VIF entry in instance network info cache for port de150d79-f1d1-4f35-9cd8-e7fef54c20c1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG nova.network.neutron [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updating instance_info_cache with network_info: [{"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ac9b698-5f95-4919-88be-a1d6ed37feda req-43350ad7-fdce-4c10-8af1-0088fcc0783a service nova] Releasing lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-ca4585a3-ff8f-4b62-b8c6-c0d701674a89 req-9f0b71fd-e632-48f0-85fc-54c340d1eeb5 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ca4585a3-ff8f-4b62-b8c6-c0d701674a89 req-9f0b71fd-e632-48f0-85fc-54c340d1eeb5 service nova] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ca4585a3-ff8f-4b62-b8c6-c0d701674a89 req-9f0b71fd-e632-48f0-85fc-54c340d1eeb5 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ca4585a3-ff8f-4b62-b8c6-c0d701674a89 req-9f0b71fd-e632-48f0-85fc-54c340d1eeb5 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-ca4585a3-ff8f-4b62-b8c6-c0d701674a89 req-9f0b71fd-e632-48f0-85fc-54c340d1eeb5 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] No waiting events found dispatching network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:24 user nova-compute[75354]: WARNING nova.compute.manager [req-ca4585a3-ff8f-4b62-b8c6-c0d701674a89 req-9f0b71fd-e632-48f0-85fc-54c340d1eeb5 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received unexpected event network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a for instance with vm_state building and task_state spawning.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:25 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Instance spawned successfully.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:25 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance spawned successfully.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:25 user nova-compute[75354]: INFO nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Took 10.91 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:25 user nova-compute[75354]: INFO nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:25 user nova-compute[75354]: INFO nova.compute.manager [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Took 12.21 seconds to build instance.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bc5f097b-3e23-48c3-9146-e363f12cd901 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.337s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:25 user nova-compute[75354]: INFO nova.compute.manager [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Took 18.35 seconds to build instance.
Nov 14 06:30:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e41bc338-641b-4a77-baa5-abea287a8b44 tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.510s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-95c2f322-0d3b-4e9a-ac78-01036e161f31 req-c5c13cad-bc6c-45d4-ab01-19c3936cf276 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-95c2f322-0d3b-4e9a-ac78-01036e161f31 req-c5c13cad-bc6c-45d4-ab01-19c3936cf276 service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-95c2f322-0d3b-4e9a-ac78-01036e161f31 req-c5c13cad-bc6c-45d4-ab01-19c3936cf276 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-95c2f322-0d3b-4e9a-ac78-01036e161f31 req-c5c13cad-bc6c-45d4-ab01-19c3936cf276 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-95c2f322-0d3b-4e9a-ac78-01036e161f31 req-c5c13cad-bc6c-45d4-ab01-19c3936cf276 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:26 user nova-compute[75354]: WARNING nova.compute.manager [req-95c2f322-0d3b-4e9a-ac78-01036e161f31 req-c5c13cad-bc6c-45d4-ab01-19c3936cf276 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba for instance with vm_state active and task_state None.
Nov 14 06:30:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:27 user nova-compute[75354]: INFO nova.compute.claims [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Claim successful on node user
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.849s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Instance spawned successfully.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:28 user nova-compute[75354]: WARNING nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba for instance with vm_state active and task_state None.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:28 user nova-compute[75354]: WARNING nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state None.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:28 user nova-compute[75354]: WARNING nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state None.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] No waiting events found dispatching network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:28 user nova-compute[75354]: WARNING nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received unexpected event network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 for instance with vm_state building and task_state spawning.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] No waiting events found dispatching network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:28 user nova-compute[75354]: WARNING nova.compute.manager [req-191c36ec-e093-4734-a899-1e3a8468608e req-9ecda68b-72da-4c0d-a04b-25606f3124f4 service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received unexpected event network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 for instance with vm_state building and task_state spawning.
Nov 14 06:30:28 user nova-compute[75354]: INFO nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Took 8.15 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.policy [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a597d2cfd49f69d93bfd148972170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedfa9b60822445facda789b60f344ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:30:28 user nova-compute[75354]: INFO nova.compute.claims [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Claim successful on node user
Nov 14 06:30:28 user nova-compute[75354]: INFO nova.virt.block_device [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Booting with volume 81b4c8a5-53de-4e8a-9b0c-a8781f3efabf at /dev/vda
Nov 14 06:30:28 user nova-compute[75354]: INFO nova.compute.manager [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Took 9.13 seconds to build instance.
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9e1713b-2531-4ea3-a080-3ce85a0fefde tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.252s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG os_brick.utils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ecacdb-a418-4c23-974a-dacedd82d579]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6640ac-5383-46c4-97ed-72cf4d50948c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87fdda-7206-46fc-bde2-383b488d6afe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef591b07-e3b7-4765-a460-fae32333b6f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:29 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbcaad2-4471-42a9-b555-1054d85b0979]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG os_brick.utils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating existing volume attachment record: bf5679e5-19d3-4213-b59c-7000181f5104 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.912s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:30:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully created port: 910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:30:30 user nova-compute[75354]: INFO nova.virt.block_device [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Booting with volume 3a2afac9-1eb9-4181-91c2-c1b4a82e1095 at /dev/vda
Nov 14 06:30:30 user nova-compute[75354]: DEBUG nova.policy [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0852a8dbff1541579ba554b6ab0704af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b8a5eefeb44585b15df33fce65ede3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG os_brick.utils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d0d74c-3472-4413-92b0-2d93939b9298]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029ff1b-93b9-452a-94a7-bb8db1febd23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea3b5c-8728-4cd8-a5a6-5b2282f09d14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd852c7e-cfc9-4719-9c33-8c8b39d901bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:30 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb290a26-18bf-4a52-9902-839bd4f461e7]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG os_brick.utils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== get_connector_properties: return (290ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating existing volume attachment record: 30ab3010-7399-4ffe-94f5-f42245d0d2a7 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully created port: e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully created port: 75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully created port: cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully created port: 716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7664MB free_disk=25.747203826904297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully created port: 35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully created port: 1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 7df258ce-f627-4b68-afa5-e0d1c8cea375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b96beb17-09e1-45a2-8699-8657baa034e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 1fc570b9-a592-425d-9c84-b67a7a37e07f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 93429017-a737-45d4-965b-d7369a440bf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9677bd15-7e09-41db-8f75-0da15ac5d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6379bb6f-54d6-4af9-bd98-f9d177676f33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:30:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:30:33 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:30:33 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:30:33 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:30:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:33 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully created port: 5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:33 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully created port: 3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully created port: 96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: 910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-910b8cb8-aaf7-4582-9d9d-47d08025d4d8. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port 910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Skipping network cache update for instance because it is Building. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Skipping network cache update for instance because it is Building. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d8b84058-a889-4493-87e5-7f1d2eaa938a req-8b91f530-4089-4b86-b763-cab602e4fe26 service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: 2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:35 user nova-compute[75354]: INFO nova.virt.block_device [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Booting with volume 989e70ad-5b32-414c-8d79-1c3ce3e7e02d at /dev/vdb
Nov 14 06:30:35 user nova-compute[75354]: DEBUG os_brick.utils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf57ea59-4d5e-4d9e-a01a-1b0003e200fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99cd809-5c2a-4d9e-b923-6bed812287f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[65882e42-060c-4877-aa00-c75f62c9948a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213f83e-2981-4e21-a302-c469d6a905c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:35 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7f8e17-29d0-40b0-88c5-2de33c09b6f3]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG os_brick.utils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating existing volume attachment record: b2eb3ddb-b7e0-4148-bdf3-3d57da9870c6 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: 75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-75a319db-14c0-4114-9c6e-d818fafe8e84. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: 5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-29ab42fa-e402-406d-bdf4-95a3bf30d7f6 req-cfbf81db-25ae-4ae9-9e87-1c4022777c8a service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-2dc28cce-fb57-4770-bda6-3ab935236bbe. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port 2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:36 user nova-compute[75354]: INFO nova.virt.block_device [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Booting with volume be69d8e4-d44d-4fd9-b8a2-03c8b1697679 at /dev/vdb
Nov 14 06:30:36 user nova-compute[75354]: DEBUG os_brick.utils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port 5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[919691cd-1fb9-455e-adbd-b1134828d2cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[781cdba8-2a20-47d6-ad1d-7985a0e6ff1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[486e790d-c31e-480c-803c-92066b9c3c99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ace0cf-26e2-40c5-b373-322bae970089]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:36 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75927733-8fbf-40af-b971-88794dfdbd69]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG os_brick.utils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating existing volume attachment record: 266799be-8b84-479c-bcbd-b5bab3736bde {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e0302e1-a3bf-4f92-bfcf-6f387737c8da req-f99ed30f-158c-4ec0-a6d9-4e2890cdce7a service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-c51db9d6-2363-4b49-a6ce-4f823ef56e15. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af31d5b1-fcc7-4bcb-88d8-6221e1b3e9e2 req-019e9beb-00a3-48a7-8d5a-bc3df8fa9f78 service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: 2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: 1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-cc3bee3c-7140-4685-8efd-47ef0114816e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Successfully updated port: 3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-1de9f506-7108-4957-a83c-5d123c23899f. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port 1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: 716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-2803bfd4-237d-4c4c-8bc1-ba3f06af623c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.network.neutron [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:39 user nova-compute[75354]: DEBUG nova.network.neutron [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a427f5e-b152-4160-9907-d9db96927baa req-3862d30f-d09a-4c8c-8304-c9725a03084f service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-716e270f-6bc1-4f8a-9968-8de88db5f1e3. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-3fab9a2e-9617-4db7-8a44-0a91d944cc4e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: 35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:40 user nova-compute[75354]: INFO nova.virt.block_device [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Booting with volume 2de19194-d8f7-4032-a257-11bd510c260b at /dev/vdc
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.network.neutron [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-89e76541-21b9-4594-a412-9f9f1a18c186 req-2ea78ae4-a446-4fa3-b538-f02cd337699e service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG os_brick.utils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55b3eb-021c-4544-872d-3396dc9be5ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6aa6b0-a0f5-4b81-8831-d3524c446dbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99ab47a-513b-450b-a8fc-8a597f9a7b45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a6261-775f-4a8d-831b-bb017fddcff2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:40 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2715d800-a8f6-495d-98ca-607220c94cec]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG os_brick.utils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:40 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating existing volume attachment record: d7c730e7-9821-40f0-b263-9226b3949d9a {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-35dddf93-0717-4cdd-9e27-939b3b74c58d. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG nova.network.neutron [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG nova.network.neutron [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: 5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e595c671-1f27-4d7a-b9db-d5d73915457b req-8d3fa088-84bd-4f63-9fbe-30536622aad0 service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Successfully updated port: 96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:30:42 user nova-compute[75354]: INFO nova.virt.block_device [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Booting with volume 92d80834-4801-4916-aba6-5c176a359785 at /dev/vdc
Nov 14 06:30:42 user nova-compute[75354]: DEBUG os_brick.utils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14551dca-c76e-43f2-86c8-56afca638027]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15978a0-cc5e-420f-9578-34a9830f94fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8721b868-c0c7-47fe-bcb6-02b4aa6a36f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb04cc4d-e054-45dc-b98e-5aec784710d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:30:43 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf05e03-d53b-4c1c-8ea3-cd2bb9f08d0b]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG os_brick.utils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating existing volume attachment record: d9a50feb-27ed-4602-91b0-b51b76663be3 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [{"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance network_info: |[{"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.network.neutron [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port 3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.compute.manager [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG nova.compute.manager [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-5e42539c-cf41-4a30-89f3-2d8444a45857. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updated VIF entry in instance network info cache for port 3fab9a2e-9617-4db7-8a44-0a91d944cc4e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [{"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8800d93a-45c5-4b35-8171-fc123a5d6b10 req-c399c663-f8ea-463f-b344-fdfffc33daa9 service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance network_info: |[{"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:30:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updated VIF entry in instance network info cache for port 5e42539c-cf41-4a30-89f3-2d8444a45857. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-96433f0d-9a51-4363-b14b-bc9a96836a2b. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Creating image(s)
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Ensure instance console log exists: /opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Start _get_guest_xml network_info=[{"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOfvSGsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6379bb6f-54d6-4af9-bd98-f9d177676f33', 'attached_at': '', 'detached_at': '', 'volume_id': '81b4c8a5-53de-4e8a-9b0c-a8781f3efabf', 'serial': '81b4c8a5-53de-4e8a-9b0c-a8781f3efabf'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'bf5679e5-19d3-4213-b59c-7000181f5104', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cdtphrge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6379bb6f-54d6-4af9-bd98-f9d177676f33', 'attached_at': '', 'detached_at': '', 'volume_id': '989e70ad-5b32-414c-8d79-1c3ce3e7e02d', 'serial': '989e70ad-5b32-414c-8d79-1c3ce3e7e02d'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'b2eb3ddb-b7e0-4148-bdf3-3d57da9870c6', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPUlscxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6379bb6f-54d6-4af9-bd98-f9d177676f33', 'attached_at': '', 'detached_at': '', 'volume_id': '2de19194-d8f7-4032-a257-11bd510c260b', 'serial': '2de19194-d8f7-4032-a257-11bd510c260b'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'd7c730e7-9821-40f0-b263-9226b3949d9a', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOfvSGsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:46 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59e162-9a87-43be-92cf-a983236b24d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:46 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82735d4-78c6-4229-8491-5d033f27f9c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf] added
Nov 14 06:30:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad28338-7b39-4c18-9f9f-97004c0fc2ce]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[554748fd-d328-4336-b2d5-8c2ca8766dd6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOfvSGsw {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOfvSGsw" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb39e7-af87-4fde-919f-eaf167d671bb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOfvSGsw'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d9be9-b921-4554-972e-770864c9f28b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5c94e-140f-4511-8169-eecac60195d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea615342-9afe-4eaf-8d8c-c6b43c901d57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260]
Nov 14 06:30:46 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5494bf0f-269d-429c-ae25-f465f06cc69a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b747d8e-d9fd-4e1d-8bae-95fd08a8d961]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:46 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7385a55-912d-4207-a4b0-b86855694f0c]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOfvSGsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updated VIF entry in instance network info cache for port 96433f0d-9a51-4363-b14b-bc9a96836a2b. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:30:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dfe5ff1b-d0a6-499d-a92f-aa293b1892d8 req-93782e1b-a731-491b-a947-bef370ead1cc service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26265623633383130', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265623633383130', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cdtphrge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:47 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:47 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:47 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3533513-815b-49ab-9ec7-7a2de13115f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:47 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af41d97-81d4-45d5-93db-355ca9117f7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d] added
Nov 14 06:30:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3493be-8f2f-454f-8e0f-61b7d055e8df]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9966c6-bf84-4c6d-bf2c-fd713a91d08f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cdtphrge {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cdtphrge" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b42a29-ce44-49d0-a63a-b3a031a0e648]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cdtphrge'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d398cb1-006b-42dd-b676-112eebcb4c8d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8835abb2-01ba-4fe4-bb0d-e989b58ed2f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a828278d-2d52-4d42-a374-bfb0a3ed9713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260]
Nov 14 06:30:47 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[703aa836-84b3-4b3b-b5e7-27a9c687dfe2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c81731-cbb3-45eb-9f40-7e12a17a2d85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:47 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf33cd-81c1-406f-9b45-0e2b5b46dee0]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:30:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Creating image(s)
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Ensure instance console log exists: /opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Start _get_guest_xml network_info=[{"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjaFRSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0227dd34-937e-4079-a37d-ef3cbc39fcf7', 'attached_at': '', 'detached_at': '', 'volume_id': '3a2afac9-1eb9-4181-91c2-c1b4a82e1095', 'serial': '3a2afac9-1eb9-4181-91c2-c1b4a82e1095'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '30ab3010-7399-4ffe-94f5-f42245d0d2a7', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grSWHpyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0227dd34-937e-4079-a37d-ef3cbc39fcf7', 'attached_at': '', 'detached_at': '', 'volume_id': 'be69d8e4-d44d-4fd9-b8a2-03c8b1697679', 'serial': 'be69d8e4-d44d-4fd9-b8a2-03c8b1697679'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '266799be-8b84-479c-bcbd-b5bab3736bde', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEhaWFeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0227dd34-937e-4079-a37d-ef3cbc39fcf7', 'attached_at': '', 'detached_at': '', 'volume_id': '92d80834-4801-4916-aba6-5c176a359785', 'serial': '92d80834-4801-4916-aba6-5c176a359785'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'd9a50feb-27ed-4602-91b0-b51b76663be3', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:30:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjaFRSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cdtphrge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23336643630623464', 'path': '/dev/sdf'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336643630623464', 'path': '/dev/sdf'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.463s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:48 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f725ae-9e2b-42ff-87b3-48a39f6f27f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:48 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPUlscxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36467a8f-ea8b-480c-ac3d-ae9edff28b1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095] added
Nov 14 06:30:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a53db5-2c99-4bc2-a375-1e2f7ee0f8f6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd14148e-0a0c-40f4-95b3-23d47b72f602]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsjaFRSD {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsjaFRSD" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd1007a-ab5a-4700-a3fd-53dd97df0afd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsjaFRSD'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae186e7e-39ab-4e3b-9b10-18f353f6e224]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b27c61-98ca-4a77-9f07-3de6bec6faf3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81821dc4-6ef5-474d-b917-cf06be1b092d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260]
Nov 14 06:30:49 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[91556a44-d8c6-4590-8719-6f93e10f3fb8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[836f32f1-2711-4d49-8a90-76477e1f05f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:49 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874997e-84f3-4b59-b38b-835b57080433]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:49 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjaFRSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== connect_volume: return (1845ms) {'type': 'block', 'scsi_wwn': '26234356636653034', 'path': '/dev/sdg'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234356636653034', 'path': '/dev/sdg'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.352s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:50 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:50 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9106456-80d4-4916-8d02-adc3d7160c1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:50 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grSWHpyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:50 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebdd2f3-59e0-4deb-896c-3ad3b0575726]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b] added
Nov 14 06:30:50 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4331bedd-8878-482c-974b-10be0ec44c88]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[35546d35-d8db-4914-b6a4-2a48a8260001]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPUlscxj {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPUlscxj" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eee09fe-caea-43f3-888e-de02b4ef6286]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPUlscxj'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d38c4-8523-48f2-a28a-28ba863c3fda]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[281ad4e9-fb78-4488-a501-ec6b9e92f768]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c304c4a-2c68-4211-98c3-114e4fabbd82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260]
Nov 14 06:30:50 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:50 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f296eca-4d3f-4ab3-aed0-594b11d5bab7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419ba65-7775-4318-b569-9c4186796366]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:50 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50703-247a-4539-be47-ef8a2c95e45c (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:50 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:50 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eca72f-07e9-4dd5-837f-2f5615533b6f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:50 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPUlscxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== connect_volume: return (2698ms) {'type': 'block', 'scsi_wwn': '23133373632653836', 'path': '/dev/sdh'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133373632653836', 'path': '/dev/sdh'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.313s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:51 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8566b97c-4745-4bcb-9d9e-1cf8e267d9b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:51 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lazy-loading 'pci_devices' on Instance uuid 6379bb6f-54d6-4af9-bd98-f9d177676f33 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e858c27b-72c6-41cc-8658-db1c76b37693]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679] added
Nov 14 06:30:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:51 user nova-compute[75354]:   <uuid>6379bb6f-54d6-4af9-bd98-f9d177676f33</uuid>
Nov 14 06:30:51 user nova-compute[75354]:   <name>instance-0000000a</name>
Nov 14 06:30:51 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:51 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:51 user nova-compute[75354]:   <metadata>
Nov 14 06:30:51 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:51 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:51 user nova-compute[75354]:       <nova:name>tempest-device-tagging-server-1631443022</nova:name>
Nov 14 06:30:51 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:46</nova:creationTime>
Nov 14 06:30:51 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:51 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:51 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:51 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:user uuid="008a597d2cfd49f69d93bfd148972170">tempest-TaggedBootDevicesTest-181223013-project-member</nova:user>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:project uuid="fedfa9b60822445facda789b60f344ec">tempest-TaggedBootDevicesTest-181223013</nova:project>
Nov 14 06:30:51 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:51 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:30:51 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="910b8cb8-aaf7-4582-9d9d-47d08025d4d8">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="2dc28cce-fb57-4770-bda6-3ab935236bbe">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="5bcf9c47-838d-4b8a-b554-d7ce0f5325e7">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.42" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="cc3bee3c-7140-4685-8efd-47ef0114816e">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="1de9f506-7108-4957-a83c-5d123c23899f">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:         <nova:port uuid="3fab9a2e-9617-4db7-8a44-0a91d944cc4e">
Nov 14 06:30:51 user nova-compute[75354]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 06:30:51 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:51 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:51 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:51 user nova-compute[75354]:   </metadata>
Nov 14 06:30:51 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:51 user nova-compute[75354]:     <system>
Nov 14 06:30:51 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:51 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:51 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:51 user nova-compute[75354]:       <entry name="serial">6379bb6f-54d6-4af9-bd98-f9d177676f33</entry>
Nov 14 06:30:51 user nova-compute[75354]:       <entry name="uuid">6379bb6f-54d6-4af9-bd98-f9d177676f33</entry>
Nov 14 06:30:51 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:51 user nova-compute[75354]:     </system>
Nov 14 06:30:51 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:51 user nova-compute[75354]:   <os>
Nov 14 06:30:51 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:51 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:51 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:51 user nova-compute[75354]:   </os>
Nov 14 06:30:51 user nova-compute[75354]:   <features>
Nov 14 06:30:51 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:51 user nova-compute[75354]:     <apic/>
Nov 14 06:30:51 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:51 user nova-compute[75354]:   </features>
Nov 14 06:30:51 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:51 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:51 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:51 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:51 user nova-compute[75354]:   </clock>
Nov 14 06:30:51 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:51 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:51 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:51 user nova-compute[75354]:   </cpu>
Nov 14 06:30:51 user nova-compute[75354]:   <devices>
Nov 14 06:30:51 user nova-compute[75354]:     <disk type="file" device="cdrom">
Nov 14 06:30:51 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 06:30:51 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33/disk.config"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="hda" bus="ide"/>
Nov 14 06:30:51 user nova-compute[75354]:     </disk>
Nov 14 06:30:51 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:51 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:51 user nova-compute[75354]:       <source dev="/dev/sde"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <serial>81b4c8a5-53de-4e8a-9b0c-a8781f3efabf</serial>
Nov 14 06:30:51 user nova-compute[75354]:     </disk>
Nov 14 06:30:51 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:51 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:51 user nova-compute[75354]:       <source dev="/dev/sdf"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <serial>989e70ad-5b32-414c-8d79-1c3ce3e7e02d</serial>
Nov 14 06:30:51 user nova-compute[75354]:     </disk>
Nov 14 06:30:51 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:51 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:51 user nova-compute[75354]:       <source dev="/dev/sdh"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="vdc" bus="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <serial>2de19194-d8f7-4032-a257-11bd510c260b</serial>
Nov 14 06:30:51 user nova-compute[75354]:     </disk>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:9b:6b:62"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tap910b8cb8-aa"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:07:62:3b"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tap2dc28cce-fb"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:73:5f:58"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tap5bcf9c47-83"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:b6:86:1e"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tape2bfb295-3f"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:b8:d1:bd"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tapcc3bee3c-71"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:d3:ed:03"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tap1de9f506-71"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:51 user nova-compute[75354]:       <mac address="fa:16:3e:b8:05:5b"/>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:51 user nova-compute[75354]:       <target dev="tap3fab9a2e-96"/>
Nov 14 06:30:51 user nova-compute[75354]:     </interface>
Nov 14 06:30:51 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:51 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33/console.log" append="off"/>
Nov 14 06:30:51 user nova-compute[75354]:     </serial>
Nov 14 06:30:51 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:51 user nova-compute[75354]:     <video>
Nov 14 06:30:51 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:51 user nova-compute[75354]:     </video>
Nov 14 06:30:51 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:51 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:51 user nova-compute[75354]:     </rng>
Nov 14 06:30:51 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:51 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:51 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:51 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:51 user nova-compute[75354]:   </devices>
Nov 14 06:30:51 user nova-compute[75354]: </domain>
Nov 14 06:30:51 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2905c0d-6130-45bc-b749-9243c1c1c71e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b912e489-4d61-5763-93cf-68de415d038a', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap910b8cb8-aa, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap910b8cb8-aa, col_values=(('qos', UUID('66580553-714e-4434-97e2-a9c403d602c3')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap910b8cb8-aa, col_values=(('external_ids', {'iface-id': '910b8cb8-aaf7-4582-9d9d-47d08025d4d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:6b:62', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af5dad-e13c-4c49-9922-1c8a031e36d0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grSWHpyG {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa')
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e039e65f-e34b-5acc-b969-58fdd8541a66', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grSWHpyG" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352ede4-5f25-44b0-aa79-cb5368625483]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grSWHpyG'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dc28cce-fb, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dc28cce-fb, col_values=(('qos', UUID('2532b974-4875-4708-88b2-564952dd85bd')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dc28cce-fb, col_values=(('external_ids', {'iface-id': '2dc28cce-fb57-4770-bda6-3ab935236bbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:62:3b', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b93fbf7-551f-41bd-98aa-e7b0c0e7e950]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb')
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c37796dc-7115-54e8-a524-c8980926ef4e', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aa4252-e5b2-48e8-9fdd-b33bc33402d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bcf9c47-83, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bcf9c47-83, col_values=(('qos', UUID('8d4aee96-540b-42fa-bef1-a41cfb5a9aee')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bcf9c47-83, col_values=(('external_ids', {'iface-id': '5bcf9c47-838d-4b8a-b554-d7ce0f5325e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:5f:58', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83')
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92395f91-2d02-539a-8963-8695ae457b55', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2bfb295-3f, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2bfb295-3f, col_values=(('qos', UUID('97fb02ca-d822-405f-b450-8db12e2015ca')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2bfb295-3f, col_values=(('external_ids', {'iface-id': 'e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:86:1e', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406e14d-8fb9-4bcf-af92-452f2708dbd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260]
Nov 14 06:30:51 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b9e08-2cbf-4d1b-a402-bdbd31243349]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f')
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67112a9c-f602-504c-8e80-c780393554ef', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0e3604-4a0b-4429-967b-c69a5b77e5a0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2029c0-5c7c-4f94-b259-57b4cb773d69 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:51 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:30:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ed2945-e681-4cad-b16a-4073d3c50d85]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grSWHpyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc3bee3c-71, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc3bee3c-71, col_values=(('qos', UUID('a139a109-bde7-4e63-bbd3-fa8b75ae67bd')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc3bee3c-71, col_values=(('external_ids', {'iface-id': 'cc3bee3c-7140-4685-8efd-47ef0114816e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:d1:bd', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71')
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e950886e-6da9-5af9-9215-5cdab533f3e7', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1de9f506-71, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1de9f506-71, col_values=(('qos', UUID('e6f6d6a9-a432-4327-966b-49f9d875cdea')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1de9f506-71, col_values=(('external_ids', {'iface-id': '1de9f506-7108-4957-a83c-5d123c23899f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ed:03', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71')
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d2f869b-074c-5c80-807f-d0e9b0191ce6', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fab9a2e-96, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fab9a2e-96, col_values=(('qos', UUID('6760b569-1b0a-4c38-9d5d-d81f521af4ee')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fab9a2e-96, col_values=(('external_ids', {'iface-id': '3fab9a2e-9617-4db7-8a44-0a91d944cc4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:05:5b', 'vm-uuid': '6379bb6f-54d6-4af9-bd98-f9d177676f33'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: INFO os_vif [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96')
Nov 14 06:30:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] No BDM found with device name hda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] No VIF found with MAC fa:16:3e:9b:6b:62, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] No VIF found with MAC fa:16:3e:b8:d1:bd, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Using config drive
Nov 14 06:30:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Creating config drive at /opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33/disk.config
Nov 14 06:30:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf12ec5h3 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf12ec5h3" returned: 0 in 0.051s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== connect_volume: return (2661ms) {'type': 'block', 'scsi_wwn': '26466386664613534', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466386664613534', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEhaWFeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:30:53 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:53 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:30:53 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb99b6-f192-45c9-bae6-a5400f98815a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:30:53 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b123b5-c0f0-4563-acf1-01666f9bed25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785] added
Nov 14 06:30:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eebfbe-1f2e-4cb0-8d68-f2685b8ea472]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.115s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d1e51-60e7-4eb0-9c9f-951da5bb54e9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cEhaWFeT {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cEhaWFeT" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9015a4d-15b7-49ad-9b89-86c1f6b9cafd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cEhaWFeT'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d81322f-d70e-4931-9796-b12ccb914e10]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4de221-3de0-49b3-a8b9-a2a82dbd3762]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e27302-a56d-458b-a6df-66c82b5a4d54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260]
Nov 14 06:30:53 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260] successful.
Nov 14 06:30:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db7022-8840-40d5-b364-6a2ec30dde0b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e625c0-1586-4d1c-a14e-a1445a4805ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:30:53 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:30:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd80de-c0bf-4dc8-82a8-fd7134ac41a0]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:30:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEhaWFeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26461623263343463', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461623263343463', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-2204093f-e418-4750-8711-698ac04cb6fb req-c25a9c39-2129-42b5-bc63-ffbb43b8737c service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2204093f-e418-4750-8711-698ac04cb6fb req-c25a9c39-2129-42b5-bc63-ffbb43b8737c service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2204093f-e418-4750-8711-698ac04cb6fb req-c25a9c39-2129-42b5-bc63-ffbb43b8737c service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2204093f-e418-4750-8711-698ac04cb6fb req-c25a9c39-2129-42b5-bc63-ffbb43b8737c service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-2204093f-e418-4750-8711-698ac04cb6fb req-c25a9c39-2129-42b5-bc63-ffbb43b8737c service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:54 user nova-compute[75354]: WARNING nova.compute.manager [req-2204093f-e418-4750-8711-698ac04cb6fb req-c25a9c39-2129-42b5-bc63-ffbb43b8737c service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 for instance with vm_state building and task_state spawning.
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lazy-loading 'pci_devices' on Instance uuid 0227dd34-937e-4079-a37d-ef3cbc39fcf7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:30:54 user nova-compute[75354]:   <uuid>0227dd34-937e-4079-a37d-ef3cbc39fcf7</uuid>
Nov 14 06:30:54 user nova-compute[75354]:   <name>instance-0000000b</name>
Nov 14 06:30:54 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:30:54 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:30:54 user nova-compute[75354]:   <metadata>
Nov 14 06:30:54 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:30:54 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:30:54 user nova-compute[75354]:       <nova:name>tempest-device-tagging-server-2132003956</nova:name>
Nov 14 06:30:54 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:30:48</nova:creationTime>
Nov 14 06:30:54 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:30:54 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:30:54 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:30:54 user nova-compute[75354]:       <nova:owner>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:user uuid="0852a8dbff1541579ba554b6ab0704af">tempest-TaggedBootDevicesTest_v242-1723211858-project-member</nova:user>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:project uuid="24b8a5eefeb44585b15df33fce65ede3">tempest-TaggedBootDevicesTest_v242-1723211858</nova:project>
Nov 14 06:30:54 user nova-compute[75354]:       </nova:owner>
Nov 14 06:30:54 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:30:54 user nova-compute[75354]:       <nova:ports>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="75a319db-14c0-4114-9c6e-d818fafe8e84">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="c51db9d6-2363-4b49-a6ce-4f823ef56e15">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.182" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="2803bfd4-237d-4c4c-8bc1-ba3f06af623c">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="716e270f-6bc1-4f8a-9968-8de88db5f1e3">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="35dddf93-0717-4cdd-9e27-939b3b74c58d">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="5e42539c-cf41-4a30-89f3-2d8444a45857">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:         <nova:port uuid="96433f0d-9a51-4363-b14b-bc9a96836a2b">
Nov 14 06:30:54 user nova-compute[75354]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 06:30:54 user nova-compute[75354]:         </nova:port>
Nov 14 06:30:54 user nova-compute[75354]:       </nova:ports>
Nov 14 06:30:54 user nova-compute[75354]:     </nova:instance>
Nov 14 06:30:54 user nova-compute[75354]:   </metadata>
Nov 14 06:30:54 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:30:54 user nova-compute[75354]:     <system>
Nov 14 06:30:54 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:30:54 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:30:54 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:30:54 user nova-compute[75354]:       <entry name="serial">0227dd34-937e-4079-a37d-ef3cbc39fcf7</entry>
Nov 14 06:30:54 user nova-compute[75354]:       <entry name="uuid">0227dd34-937e-4079-a37d-ef3cbc39fcf7</entry>
Nov 14 06:30:54 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:30:54 user nova-compute[75354]:     </system>
Nov 14 06:30:54 user nova-compute[75354]:   </sysinfo>
Nov 14 06:30:54 user nova-compute[75354]:   <os>
Nov 14 06:30:54 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:30:54 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:30:54 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:30:54 user nova-compute[75354]:   </os>
Nov 14 06:30:54 user nova-compute[75354]:   <features>
Nov 14 06:30:54 user nova-compute[75354]:     <acpi/>
Nov 14 06:30:54 user nova-compute[75354]:     <apic/>
Nov 14 06:30:54 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:30:54 user nova-compute[75354]:   </features>
Nov 14 06:30:54 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:30:54 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:30:54 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:30:54 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:30:54 user nova-compute[75354]:   </clock>
Nov 14 06:30:54 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:30:54 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:30:54 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:30:54 user nova-compute[75354]:   </cpu>
Nov 14 06:30:54 user nova-compute[75354]:   <devices>
Nov 14 06:30:54 user nova-compute[75354]:     <disk type="file" device="cdrom">
Nov 14 06:30:54 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 06:30:54 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7/disk.config"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="hda" bus="ide"/>
Nov 14 06:30:54 user nova-compute[75354]:     </disk>
Nov 14 06:30:54 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:54 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:54 user nova-compute[75354]:       <source dev="/dev/sdg"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <serial>3a2afac9-1eb9-4181-91c2-c1b4a82e1095</serial>
Nov 14 06:30:54 user nova-compute[75354]:     </disk>
Nov 14 06:30:54 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:54 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:54 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <serial>be69d8e4-d44d-4fd9-b8a2-03c8b1697679</serial>
Nov 14 06:30:54 user nova-compute[75354]:     </disk>
Nov 14 06:30:54 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:30:54 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:30:54 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="vdc" bus="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <serial>92d80834-4801-4916-aba6-5c176a359785</serial>
Nov 14 06:30:54 user nova-compute[75354]:     </disk>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:2c:5c:1f"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tap75a319db-14"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:e6:35:c4"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tapc51db9d6-23"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:94:01:a9"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tap2803bfd4-23"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:86:01:da"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tap716e270f-6b"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:84:58:73"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tap35dddf93-07"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:e1:28:27"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tap5e42539c-cf"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:30:54 user nova-compute[75354]:       <mac address="fa:16:3e:e4:8c:dd"/>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:30:54 user nova-compute[75354]:       <target dev="tap96433f0d-9a"/>
Nov 14 06:30:54 user nova-compute[75354]:     </interface>
Nov 14 06:30:54 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:30:54 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7/console.log" append="off"/>
Nov 14 06:30:54 user nova-compute[75354]:     </serial>
Nov 14 06:30:54 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:30:54 user nova-compute[75354]:     <video>
Nov 14 06:30:54 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:30:54 user nova-compute[75354]:     </video>
Nov 14 06:30:54 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:30:54 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:30:54 user nova-compute[75354]:     </rng>
Nov 14 06:30:54 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:30:54 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:30:54 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:30:54 user nova-compute[75354]:     </memballoon>
Nov 14 06:30:54 user nova-compute[75354]:   </devices>
Nov 14 06:30:54 user nova-compute[75354]: </domain>
Nov 14 06:30:54 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39dccadf-5a37-568c-8f6b-ac4ee8eb5cb2', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a319db-14, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a319db-14, col_values=(('qos', UUID('d553faf7-a24e-47c1-a79e-c69d6fc8914c')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a319db-14, col_values=(('external_ids', {'iface-id': '75a319db-14c0-4114-9c6e-d818fafe8e84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:5c:1f', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14')
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3dc9ae1-f6eb-56f1-97d9-c6b809042868', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc51db9d6-23, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc51db9d6-23, col_values=(('qos', UUID('cb8b4757-7705-4f17-b8cb-60d8e83306ad')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc51db9d6-23, col_values=(('external_ids', {'iface-id': 'c51db9d6-2363-4b49-a6ce-4f823ef56e15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:35:c4', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23')
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4756103d-4d2d-5385-9892-1f0f83f638e0', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2803bfd4-23, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2803bfd4-23, col_values=(('qos', UUID('313e6df9-1967-4dde-a575-4f5f2ebdb588')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2803bfd4-23, col_values=(('external_ids', {'iface-id': '2803bfd4-237d-4c4c-8bc1-ba3f06af623c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:01:a9', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23')
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae7eb395-ca3f-50c9-b1ca-bc11e7e41352', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-a13f8d1a-1d67-4ffc-bc05-a38c790488d3 req-2872bdf1-da34-461a-8231-4ed889a162f6 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a13f8d1a-1d67-4ffc-bc05-a38c790488d3 req-2872bdf1-da34-461a-8231-4ed889a162f6 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a13f8d1a-1d67-4ffc-bc05-a38c790488d3 req-2872bdf1-da34-461a-8231-4ed889a162f6 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a13f8d1a-1d67-4ffc-bc05-a38c790488d3 req-2872bdf1-da34-461a-8231-4ed889a162f6 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-a13f8d1a-1d67-4ffc-bc05-a38c790488d3 req-2872bdf1-da34-461a-8231-4ed889a162f6 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:55 user nova-compute[75354]: WARNING nova.compute.manager [req-a13f8d1a-1d67-4ffc-bc05-a38c790488d3 req-2872bdf1-da34-461a-8231-4ed889a162f6 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f for instance with vm_state building and task_state spawning.
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap716e270f-6b, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap716e270f-6b, col_values=(('qos', UUID('668756d2-df15-4a4a-ad78-c6825f1e6f1e')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap716e270f-6b, col_values=(('external_ids', {'iface-id': '716e270f-6bc1-4f8a-9968-8de88db5f1e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:01:da', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b')
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c744e96-9de1-5732-870a-c8bb7b2d4551', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35dddf93-07, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35dddf93-07, col_values=(('qos', UUID('837a3eec-b12e-4e79-a8e7-0f978224180f')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35dddf93-07, col_values=(('external_ids', {'iface-id': '35dddf93-0717-4cdd-9e27-939b3b74c58d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:58:73', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07')
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-f0dbde76-27de-4b3c-ae9e-8fcd79fcb19e req-de72e434-0579-4b7e-bbe7-4ccb58daaa2f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f0dbde76-27de-4b3c-ae9e-8fcd79fcb19e req-de72e434-0579-4b7e-bbe7-4ccb58daaa2f service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f0dbde76-27de-4b3c-ae9e-8fcd79fcb19e req-de72e434-0579-4b7e-bbe7-4ccb58daaa2f service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f0dbde76-27de-4b3c-ae9e-8fcd79fcb19e req-de72e434-0579-4b7e-bbe7-4ccb58daaa2f service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-f0dbde76-27de-4b3c-ae9e-8fcd79fcb19e req-de72e434-0579-4b7e-bbe7-4ccb58daaa2f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:55 user nova-compute[75354]: WARNING nova.compute.manager [req-f0dbde76-27de-4b3c-ae9e-8fcd79fcb19e req-de72e434-0579-4b7e-bbe7-4ccb58daaa2f service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e for instance with vm_state building and task_state spawning.
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3baa89c-e864-5e7c-bc88-56d9068bc906', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e42539c-cf, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e42539c-cf, col_values=(('qos', UUID('8d7a78aa-7ee1-4d36-9f4f-37140a9f4f7b')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e42539c-cf, col_values=(('external_ids', {'iface-id': '5e42539c-cf41-4a30-89f3-2d8444a45857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:28:27', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf')
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59d6d81e-94e7-581f-8e6f-1406ed680b75', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96433f0d-9a, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96433f0d-9a, col_values=(('qos', UUID('ca979be3-25e0-4259-9a6b-e3dee0d3edc4')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96433f0d-9a, col_values=(('external_ids', {'iface-id': '96433f0d-9a51-4363-b14b-bc9a96836a2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:8c:dd', 'vm-uuid': '0227dd34-937e-4079-a37d-ef3cbc39fcf7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: INFO os_vif [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a')
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] No BDM found with device name hda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] No VIF found with MAC fa:16:3e:2c:5c:1f, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] No VIF found with MAC fa:16:3e:84:58:73, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:30:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Using config drive
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:56 user nova-compute[75354]: WARNING nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 for instance with vm_state building and task_state spawning.
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:56 user nova-compute[75354]: WARNING nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe for instance with vm_state building and task_state spawning.
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:56 user nova-compute[75354]: WARNING nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe for instance with vm_state building and task_state spawning.
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:56 user nova-compute[75354]: WARNING nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 for instance with vm_state building and task_state spawning.
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:56 user nova-compute[75354]: WARNING nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 for instance with vm_state building and task_state spawning.
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:56 user nova-compute[75354]: WARNING nova.compute.manager [req-ccb856f1-75e1-4bb8-837b-65271a999565 req-27b254c0-314f-4ea8-8466-e26ae6dfd442 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f for instance with vm_state building and task_state spawning.
Nov 14 06:30:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Creating config drive at /opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7/disk.config
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpme8b5rbt {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpme8b5rbt" returned: 0 in 0.054s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:30:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:57 user nova-compute[75354]: WARNING nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f for instance with vm_state building and task_state spawning.
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:57 user nova-compute[75354]: WARNING nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e for instance with vm_state building and task_state spawning.
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:57 user nova-compute[75354]: WARNING nova.compute.manager [req-14a9fad1-e589-498d-bbe1-198a874ce0b4 req-7ebda9aa-d440-4c72-8e74-7f38cb6a0cef service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e for instance with vm_state building and task_state spawning.
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-07d126ba-792b-440c-b2d9-52e2acfcf551 req-785d5a63-f217-41b9-b327-08702fbafce9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-07d126ba-792b-440c-b2d9-52e2acfcf551 req-785d5a63-f217-41b9-b327-08702fbafce9 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-07d126ba-792b-440c-b2d9-52e2acfcf551 req-785d5a63-f217-41b9-b327-08702fbafce9 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-07d126ba-792b-440c-b2d9-52e2acfcf551 req-785d5a63-f217-41b9-b327-08702fbafce9 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-07d126ba-792b-440c-b2d9-52e2acfcf551 req-785d5a63-f217-41b9-b327-08702fbafce9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:57 user nova-compute[75354]: WARNING nova.compute.manager [req-07d126ba-792b-440c-b2d9-52e2acfcf551 req-785d5a63-f217-41b9-b327-08702fbafce9 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e for instance with vm_state building and task_state spawning.
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:30:58 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance spawned successfully.
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: INFO nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Took 12.55 seconds to spawn the instance on the hypervisor.
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-faae50df-8610-48fa-9e39-d5dae271063c req-bbdf17ce-e699-4b7f-b16e-2ed04102d12e service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-faae50df-8610-48fa-9e39-d5dae271063c req-bbdf17ce-e699-4b7f-b16e-2ed04102d12e service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-faae50df-8610-48fa-9e39-d5dae271063c req-bbdf17ce-e699-4b7f-b16e-2ed04102d12e service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-faae50df-8610-48fa-9e39-d5dae271063c req-bbdf17ce-e699-4b7f-b16e-2ed04102d12e service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-faae50df-8610-48fa-9e39-d5dae271063c req-bbdf17ce-e699-4b7f-b16e-2ed04102d12e service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:58 user nova-compute[75354]: WARNING nova.compute.manager [req-faae50df-8610-48fa-9e39-d5dae271063c req-bbdf17ce-e699-4b7f-b16e-2ed04102d12e service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f for instance with vm_state building and task_state spawning.
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: INFO nova.compute.manager [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Took 31.31 seconds to build instance.
Nov 14 06:30:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8ff4cb60-c6c2-4a87-a161-4206e74beb1c tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.456s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:59 user nova-compute[75354]: WARNING nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 for instance with vm_state building and task_state spawning.
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:59 user nova-compute[75354]: WARNING nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 for instance with vm_state building and task_state spawning.
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:59 user nova-compute[75354]: WARNING nova.compute.manager [req-92f8b724-079a-4123-8895-43fc77433025 req-e9743349-a4cb-41c7-8e3c-afca35920273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 for instance with vm_state building and task_state spawning.
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:59 user nova-compute[75354]: WARNING nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 for instance with vm_state building and task_state spawning.
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:59 user nova-compute[75354]: WARNING nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 for instance with vm_state building and task_state spawning.
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:30:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:30:59 user nova-compute[75354]: WARNING nova.compute.manager [req-2b6bfc99-7f3f-4881-b00f-b061e324d539 req-af14362b-a2f0-4b0d-8ac1-44aba48d8394 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d for instance with vm_state building and task_state spawning.
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:00 user nova-compute[75354]: WARNING nova.compute.manager [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c for instance with vm_state building and task_state spawning.
Nov 14 06:31:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:00 user nova-compute[75354]: WARNING nova.compute.manager [req-e5844860-08fb-4a0f-add1-e3f4bbedf202 req-10f7b5a0-c2c9-469c-9f0c-f27f0d70143e service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c for instance with vm_state building and task_state spawning.
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:01 user nova-compute[75354]: WARNING nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 for instance with vm_state building and task_state spawning.
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:01 user nova-compute[75354]: WARNING nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 for instance with vm_state building and task_state spawning.
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:01 user nova-compute[75354]: WARNING nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 for instance with vm_state building and task_state spawning.
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:01 user nova-compute[75354]: WARNING nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b for instance with vm_state building and task_state spawning.
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:01 user nova-compute[75354]: WARNING nova.compute.manager [req-66c859f9-f6df-404a-bf81-38815e6a2dca req-0a54d268-fdd7-41b6-bef1-fc509d5a8624 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b for instance with vm_state building and task_state spawning.
Nov 14 06:31:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-20bbac24-ec4a-47d8-958f-1391ed81523a req-41134b21-8e33-46d1-86a7-8ea74e94ac8f service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-20bbac24-ec4a-47d8-958f-1391ed81523a req-41134b21-8e33-46d1-86a7-8ea74e94ac8f service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-20bbac24-ec4a-47d8-958f-1391ed81523a req-41134b21-8e33-46d1-86a7-8ea74e94ac8f service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-20bbac24-ec4a-47d8-958f-1391ed81523a req-41134b21-8e33-46d1-86a7-8ea74e94ac8f service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-20bbac24-ec4a-47d8-958f-1391ed81523a req-41134b21-8e33-46d1-86a7-8ea74e94ac8f service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:02 user nova-compute[75354]: WARNING nova.compute.manager [req-20bbac24-ec4a-47d8-958f-1391ed81523a req-41134b21-8e33-46d1-86a7-8ea74e94ac8f service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d for instance with vm_state building and task_state spawning.
Nov 14 06:31:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:31:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance spawned successfully.
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:31:02 user nova-compute[75354]: INFO nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Took 14.35 seconds to spawn the instance on the hypervisor.
Nov 14 06:31:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:31:02 user nova-compute[75354]: INFO nova.compute.manager [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Took 34.16 seconds to build instance.
Nov 14 06:31:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e128c342-ccb4-4133-88b0-25a68c37932b tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.309s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-changed-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Refreshing instance network info cache due to event network-changed-307913af-8833-4c78-8600-a43bbc913f5a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:25 user nova-compute[75354]: DEBUG nova.network.neutron [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Refreshing network info cache for port 307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updated VIF entry in instance network info cache for port 307913af-8833-4c78-8600-a43bbc913f5a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8458c74e-5298-4a9d-89d3-003a1f86d352 req-b49ad5bb-a831-401e-a7bb-c964847d53cd service nova] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-changed-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Refreshing instance network info cache due to event network-changed-edb76634-c756-41ed-ace4-5b82d24b5365. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Refreshing network info cache for port edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updated VIF entry in instance network info cache for port edb76634-c756-41ed-ace4-5b82d24b5365. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e920b1bf-dbdb-4137-8926-7b7b941be856 req-b1d4365d-5352-4617-b0de-d6ba3f3d26bf service nova] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:31:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:31:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=6893MB free_disk=25.630889892578125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lazy-loading 'flavor' on Instance uuid 7df258ce-f627-4b68-afa5-e0d1c8cea375 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 7df258ce-f627-4b68-afa5-e0d1c8cea375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b96beb17-09e1-45a2-8699-8657baa034e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 1fc570b9-a592-425d-9c84-b67a7a37e07f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 93429017-a737-45d4-965b-d7369a440bf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9677bd15-7e09-41db-8f75-0da15ac5d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6379bb6f-54d6-4af9-bd98-f9d177676f33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:31 user nova-compute[75354]: INFO nova.compute.manager [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Attaching volume 1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a to /dev/vdb
Nov 14 06:31:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e994a4-3781-4fef-b225-254e0c372ed1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca8b6ce-80b3-40ae-ac07-993c559f0893]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9938c0-6362-4a44-898f-6a1ce910c51e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d75dec3-5cac-498c-a2f3-b89a3ef41a5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:32 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1dc0d-6739-4473-9657-b740dc4029ad]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Updating existing volume attachment record: 8caba9a5-24a3-4df8-9948-95cab03e86a8 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:32 user nova-compute[75354]: INFO nova.compute.manager [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Attaching volume 6e4ddb08-ad6c-4d7b-952a-5c9793268241 to /dev/vdb
Nov 14 06:31:32 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b78573-2861-4956-beae-8806420f4a8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.314s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3143a7c-bbb4-41b3-8da9-fdfdf879d960]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa19605-8560-4d72-b7a2-23fc0b5b1c65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f21f61-d992-40ab-b59d-016cc50138ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:32 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:31:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a710eb5-3757-4d51-aef9-4c38008a3f0a]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating existing volume attachment record: 4e2a0c21-123d-4b8c-ba31-b5ace2f31b45 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:31:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhGMriky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:36 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6a8e39-72a6-444f-a375-bdacdfe78408]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:31:36 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a24c0-f0d2-4d48-8ed7-c6b61eb60129]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a] added
Nov 14 06:31:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7803cec-efdd-4cf7-99ac-572bea91835b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe459e22-933d-4fff-90fb-ba9f326b90e1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhGMriky {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhGMriky" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a8b7b-9de6-4dad-b74a-a0a91c2730cf]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qhGMriky'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[827377d4-06af-4cf3-95f7-acca9eda7643]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fae69e-bad6-4fac-b613-df810ce0326a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da7fe4-4ad7-4640-951a-d7efc8acd730]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260]
Nov 14 06:31:36 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260] successful.
Nov 14 06:31:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdc210-05aa-4d23-86fe-c29a45e77f7c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754393d-2ef7-41e9-afa4-ed18ded7d76d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:36 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5cc55c-a04a-4524-abb8-0e4000c7e94d]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:31:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhGMriky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23061343630663466', 'path': '/dev/sdi'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061343630663466', 'path': '/dev/sdi'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.130s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:37 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:37 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lazy-loading 'flavor' on Instance uuid 7df258ce-f627-4b68-afa5-e0d1c8cea375 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fd2b40-d6c2-4d3e-8201-a95463695945]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:31:37 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:31:37 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:31:37 user nova-compute[75354]:   <source dev="/dev/sdi"/>
Nov 14 06:31:37 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:31:37 user nova-compute[75354]:   <serial>1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a</serial>
Nov 14 06:31:37 user nova-compute[75354]: </disk>
Nov 14 06:31:37 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb44c017-95f0-45e1-b256-0c17d37fdbd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241] added
Nov 14 06:31:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229bc18-b6cf-4c42-b385-97f03c0f624c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90a389-5f7a-44c4-990e-fcf27824d91e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXiBztOH {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXiBztOH" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1febb0-94ca-4c37-b631-b638225ba1d2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXiBztOH'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abcfac4-3fbc-4c7a-92ac-f871987d71ed]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[151c2e6a-261e-48b9-9017-7402fedc022c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:37 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184419e-fde2-4d11-bea1-c998711c3f91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]
Nov 14 06:31:38 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.
Nov 14 06:31:38 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd299be1-2e84-4c04-b851-86163889c89a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8bf6b7-7353-4b78-961d-166303b1d0ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:38 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:38 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[643023ac-d236-4c0d-a9b8-f3ffc07f015a]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] No VIF found with MAC fa:16:3e:5a:cd:c6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:31:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5168ab9-e98a-47ec-b9b3-59328040289e tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.473s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== connect_volume: return (2473ms) {'type': 'block', 'scsi_wwn': '23039323166336165', 'path': '/dev/sdj'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039323166336165', 'path': '/dev/sdj'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:31:39 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:31:39 user nova-compute[75354]:   <source dev="/dev/sdj"/>
Nov 14 06:31:39 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:31:39 user nova-compute[75354]:   <serial>6e4ddb08-ad6c-4d7b-952a-5c9793268241</serial>
Nov 14 06:31:39 user nova-compute[75354]: </disk>
Nov 14 06:31:39 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:39 user nova-compute[75354]: INFO nova.compute.manager [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Terminating instance
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-d5080eaa-604f-42b4-90ed-07d60325e201 req-cbef870d-8635-48d2-88cc-5a643b69487c service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-vif-unplugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d5080eaa-604f-42b4-90ed-07d60325e201 req-cbef870d-8635-48d2-88cc-5a643b69487c service nova] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d5080eaa-604f-42b4-90ed-07d60325e201 req-cbef870d-8635-48d2-88cc-5a643b69487c service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d5080eaa-604f-42b4-90ed-07d60325e201 req-cbef870d-8635-48d2-88cc-5a643b69487c service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-d5080eaa-604f-42b4-90ed-07d60325e201 req-cbef870d-8635-48d2-88cc-5a643b69487c service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] No waiting events found dispatching network-vif-unplugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-d5080eaa-604f-42b4-90ed-07d60325e201 req-cbef870d-8635-48d2-88cc-5a643b69487c service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-vif-unplugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No VIF found with MAC fa:16:3e:1b:86:63, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f5b26a32-87b5-4502-b900-c228582ab955 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.540s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Instance destroyed successfully.
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.objects.instance [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lazy-loading 'resources' on Instance uuid 7df258ce-f627-4b68-afa5-e0d1c8cea375 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1446161305',display_name='tempest-DeleteServersTestJSON-server-1446161305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1446161305',id=3,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c23d3709300f4fe58a3c792bf176ab30',ramdisk_id='',reservation_id='r-sz7z0qbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-463380467',owner_user_name='tempest-DeleteServersTestJSON-463380467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:29:54Z,user_data=None,user_id='7d4a6f66dcb045c9affbc58c80d940ce',uuid=7df258ce-f627-4b68-afa5-e0d1c8cea375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Converting VIF {"id": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "address": "fa:16:3e:5a:cd:c6", "network": {"id": "8b95ee75-ec6f-4900-bb7b-6415d9dca75a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-157172620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23d3709300f4fe58a3c792bf176ab30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafe8f6bf-7c", "ovs_interfaceid": "afe8f6bf-7c25-4baa-912f-263ad2c41041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_vif [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafe8f6bf-7c, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=912edb57-d672-4bee-8c6a-7c73f9262a0e) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:40 user nova-compute[75354]: INFO os_vif [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:c6,bridge_name='br-int',has_traffic_filtering=True,id=afe8f6bf-7c25-4baa-912f-263ad2c41041,network=Network(8b95ee75-ec6f-4900-bb7b-6415d9dca75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafe8f6bf-7c')
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhGMriky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:40 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c55776-f5cd-44e6-82eb-6854a493e1de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:31:40 user nova-compute[75354]: No targets found.
Nov 14 06:31:40 user nova-compute[75354]: iSNS:
Nov 14 06:31:40 user nova-compute[75354]: No targets found.
Nov 14 06:31:40 user nova-compute[75354]: STATIC:
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:31:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:31:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:31:40 user nova-compute[75354]: FIRMWARE:
Nov 14 06:31:40 user nova-compute[75354]: No targets found.
Nov 14 06:31:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:31:40 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:31:40 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f718e-89e2-4370-8eb5-43c5e8d43034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce05da37-6438-4a4a-b8ab-4ec6acff397b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:40 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80942d2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a'): ({'sdi'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Removing single pathed devices sdi {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df44ea-8792-4074-b659-0ffd0d994cb6]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7519050c-f0b2-4c50-b039-2564c19b7cee]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Flushing IO for device /dev/sdi {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22858f6-d65e-415d-8afb-a86155958591]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[342b64d9-abb6-464f-8d17-87687dd82e41]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] SCSI volumes sdi have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0e42e-175b-4193-b5e2-a95cf2158826]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cd18f2-2274-4837-8fa1-9291270c5d7b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260]
Nov 14 06:31:40 user nova-compute[75354]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a, portal: 172.16.0.220,3260] successful.
Nov 14 06:31:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d52ace5-3f5d-401f-9cbd-d6ecd8022d1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b451b3-02a4-429f-8c4c-1c6e53c088b0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] <== disconnect_volume: return (324ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:31:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Deleting instance files /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375_del
Nov 14 06:31:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Deletion of /opt/stack/data/nova/instances/7df258ce-f627-4b68-afa5-e0d1c8cea375_del complete
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75354) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 06:31:40 user nova-compute[75354]: INFO nova.virt.libvirt.host [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] UEFI support detected
Nov 14 06:31:40 user nova-compute[75354]: INFO nova.compute.manager [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75354) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 06:31:40 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-220028c5-9ac1-4840-ae26-6b675fb07a1a req-6d8a7fad-3d39-4017-a303-040ec821ff72 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-220028c5-9ac1-4840-ae26-6b675fb07a1a req-6d8a7fad-3d39-4017-a303-040ec821ff72 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-220028c5-9ac1-4840-ae26-6b675fb07a1a req-6d8a7fad-3d39-4017-a303-040ec821ff72 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-220028c5-9ac1-4840-ae26-6b675fb07a1a req-6d8a7fad-3d39-4017-a303-040ec821ff72 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-220028c5-9ac1-4840-ae26-6b675fb07a1a req-6d8a7fad-3d39-4017-a303-040ec821ff72 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:41 user nova-compute[75354]: WARNING nova.compute.manager [req-220028c5-9ac1-4840-ae26-6b675fb07a1a req-6d8a7fad-3d39-4017-a303-040ec821ff72 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state powering-off.
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:41 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Took 0.78 seconds to deallocate network for instance.
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] Acquiring lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] No waiting events found dispatching network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:41 user nova-compute[75354]: WARNING nova.compute.manager [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received unexpected event network-vif-plugged-afe8f6bf-7c25-4baa-912f-263ad2c41041 for instance with vm_state active and task_state deleting.
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-7a83bb83-e1b2-4f5f-9df9-fa72d0411e69 req-c097edb9-4f75-44ad-9320-2d8f930454e1 service nova] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Received event network-vif-deleted-afe8f6bf-7c25-4baa-912f-263ad2c41041 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance destroyed successfully.
Nov 14 06:31:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:31:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b77909c5-c85c-422d-974f-a4843420e69b tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.081s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:42 user nova-compute[75354]: INFO nova.compute.manager [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] [instance: 7df258ce-f627-4b68-afa5-e0d1c8cea375] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 06:31:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:42 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:31:42 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:31:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:42 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Deleted allocations for instance 7df258ce-f627-4b68-afa5-e0d1c8cea375
Nov 14 06:31:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-361e5720-ad24-45fe-8299-c2644d3d09dd tempest-DeleteServersTestJSON-463380467 tempest-DeleteServersTestJSON-463380467-project-member] Lock "7df258ce-f627-4b68-afa5-e0d1c8cea375" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.318s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:43 user nova-compute[75354]: DEBUG nova.compute.manager [req-603bc95e-e912-463a-a148-1d547418ee87 req-7fd1f447-1c85-4718-b394-05e80305c393 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-603bc95e-e912-463a-a148-1d547418ee87 req-7fd1f447-1c85-4718-b394-05e80305c393 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-603bc95e-e912-463a-a148-1d547418ee87 req-7fd1f447-1c85-4718-b394-05e80305c393 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-603bc95e-e912-463a-a148-1d547418ee87 req-7fd1f447-1c85-4718-b394-05e80305c393 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:43 user nova-compute[75354]: DEBUG nova.compute.manager [req-603bc95e-e912-463a-a148-1d547418ee87 req-7fd1f447-1c85-4718-b394-05e80305c393 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:43 user nova-compute[75354]: WARNING nova.compute.manager [req-603bc95e-e912-463a-a148-1d547418ee87 req-7fd1f447-1c85-4718-b394-05e80305c393 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state stopped and task_state None.
Nov 14 06:31:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-changed-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Refreshing instance network info cache due to event network-changed-dbfc4596-8f58-48ea-b4b8-b9452493e3c3. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] Acquiring lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] Acquired lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Refreshing network info cache for port dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updated VIF entry in instance network info cache for port dbfc4596-8f58-48ea-b4b8-b9452493e3c3. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updating instance_info_cache with network_info: [{"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8d3e103c-13a6-4390-8403-d6236472026a req-b6bc41aa-f2f5-4a6f-b858-de1e80d2357c service nova] Releasing lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'flavor' on Instance uuid b96beb17-09e1-45a2-8699-8657baa034e8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:50 user nova-compute[75354]: INFO nova.compute.manager [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Attaching volume e074f541-ed81-43a0-baf9-7d5709cb8d2f to /dev/vdb
Nov 14 06:31:50 user nova-compute[75354]: DEBUG os_brick.utils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb732743-de5b-4aba-84f6-1322d6dc5ac6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a6c139-0432-42b6-8438-61e150f25438]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b6f2a4-9f93-48e4-9758-47a85ca24a06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1109cfc-c15f-45a6-aae8-c310a010744d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:50 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:31:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4f49b-2267-44f9-9546-de6080458bb6]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG os_brick.utils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:50 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updating existing volume attachment record: 9035dd1a-4bd1-4367-91e1-14e2e504e42c {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-changed-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Refreshing instance network info cache due to event network-changed-6931719e-5eaf-4f1b-b88d-de1896c208fe. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] Acquiring lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] Acquired lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Refreshing network info cache for port 6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updated VIF entry in instance network info cache for port 6931719e-5eaf-4f1b-b88d-de1896c208fe. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updating instance_info_cache with network_info: [{"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-626f2b0d-19e5-4490-b338-40c7259d3228 req-5591bd39-5b8b-41e0-b419-0b7095c2dbe8 service nova] Releasing lock "refresh_cache-1fc570b9-a592-425d-9c84-b67a7a37e07f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lazy-loading 'flavor' on Instance uuid 1fc570b9-a592-425d-9c84-b67a7a37e07f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:54 user nova-compute[75354]: INFO nova.compute.manager [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Attaching volume cf7e461d-8bcd-46a4-b8a4-84903a77db6e to /dev/sdc
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.utils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37366b27-182c-4181-9ca7-a6011cd75d22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca5767c-7225-441e-9b88-00d150ac3bf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f222e-c26a-4572-a708-98dd2947aaea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec040251-3255-4d01-9be6-4065826820b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:54 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294628e-1402-46dc-91cf-814bfeabc98f]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.utils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updating existing volume attachment record: 304f2dbc-813f-4c3f-9a85-1e6a5bc5dc91 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-changed-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Refreshing instance network info cache due to event network-changed-11e84908-3332-4724-b02f-2c747cfd3dba. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] Acquiring lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] Acquired lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Refreshing network info cache for port 11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "interface-6b2df786-b4e7-4593-b73b-4ee8d54f92e6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "interface-6b2df786-b4e7-4593-b73b-4ee8d54f92e6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'flavor' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'pci_requests' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.objects.base [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Object Instance<6b2df786-b4e7-4593-b73b-4ee8d54f92e6> lazy-loaded attributes: flavor,pci_requests {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.policy [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ca6db752d9740d396768a204f73874f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad9cd240eea481eb57ebf0a143f237e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZuKCXbOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:54 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ff6d5-9a94-4967-b0ae-5393797bcd26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:31:54 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8cb0fe-9dc1-4a28-afe5-d0619052459d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f] added
Nov 14 06:31:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a24457-59aa-4580-8439-afb29f269fb3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a3733c-a0e9-4281-bc21-f26dd9eff11c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZuKCXbOW {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZuKCXbOW" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[980cb3fd-2e74-4aff-bc43-467b72d39f72]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZuKCXbOW'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8babbd78-149a-4973-9344-44c5e3ccf7a3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updated VIF entry in instance network info cache for port 11e84908-3332-4724-b02f-2c747cfd3dba. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ddec5ac-8194-4433-858c-89f4f243d0ee req-a49c6983-7e9e-49ed-8f5d-cfa1bf441107 service nova] Releasing lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe0e67-8679-4c74-8074-10fa354482b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee99ca-9c13-442d-8959-25eaf04b3f4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260]
Nov 14 06:31:55 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260] successful.
Nov 14 06:31:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d1ee03-9a14-41cd-8564-b3f28068fd17]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa059a-ad05-4ad9-bb5d-f27f07aa9895]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:55 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82958d8e-d40b-4416-b9f3-df47d1c11768]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZuKCXbOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:31:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Successfully created port: d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Successfully updated port: d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquired lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-changed-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Refreshing instance network info cache due to event network-changed-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] Acquiring lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23663353236646165', 'path': '/dev/sdi'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663353236646165', 'path': '/dev/sdi'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'flavor' on Instance uuid b96beb17-09e1-45a2-8699-8657baa034e8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:31:56 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:31:56 user nova-compute[75354]:   <source dev="/dev/sdi"/>
Nov 14 06:31:56 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:31:56 user nova-compute[75354]:   <serial>e074f541-ed81-43a0-baf9-7d5709cb8d2f</serial>
Nov 14 06:31:56 user nova-compute[75354]: </disk>
Nov 14 06:31:56 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Releasing lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] Acquired lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Refreshing network info cache for port d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG os_vif [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e028be77-8e84-5867-922e-3eb130b203ad', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd191d6b3-6e, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd191d6b3-6e, col_values=(('qos', UUID('d165fd1e-e148-40af-a11f-9b7d10f1c6da')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd191d6b3-6e, col_values=(('external_ids', {'iface-id': 'd191d6b3-6ebb-460f-8403-49eb5a9fc0ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:8d:3a', 'vm-uuid': '6b2df786-b4e7-4593-b73b-4ee8d54f92e6'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: INFO os_vif [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e')
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] attach device xml: <interface type="ethernet">
Nov 14 06:31:56 user nova-compute[75354]:   <mac address="fa:16:3e:d8:8d:3a"/>
Nov 14 06:31:56 user nova-compute[75354]:   <model type="virtio"/>
Nov 14 06:31:56 user nova-compute[75354]:   <mtu size="1442"/>
Nov 14 06:31:56 user nova-compute[75354]:   <target dev="tapd191d6b3-6e"/>
Nov 14 06:31:56 user nova-compute[75354]: </interface>
Nov 14 06:31:56 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No VIF found with MAC fa:16:3e:d5:66:2e, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ebe27c30-4e63-4ab6-864f-dd5cfde34078 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.641s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-860af117-5b62-4957-9de8-65138d60aa17 req-d05988da-fdf8-49f3-a27c-6937e18e9d4a service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-860af117-5b62-4957-9de8-65138d60aa17 req-d05988da-fdf8-49f3-a27c-6937e18e9d4a service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-860af117-5b62-4957-9de8-65138d60aa17 req-d05988da-fdf8-49f3-a27c-6937e18e9d4a service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-860af117-5b62-4957-9de8-65138d60aa17 req-d05988da-fdf8-49f3-a27c-6937e18e9d4a service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-860af117-5b62-4957-9de8-65138d60aa17 req-d05988da-fdf8-49f3-a27c-6937e18e9d4a service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:57 user nova-compute[75354]: WARNING nova.compute.manager [req-860af117-5b62-4957-9de8-65138d60aa17 req-d05988da-fdf8-49f3-a27c-6937e18e9d4a service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca for instance with vm_state active and task_state None.
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No BDM found with device name hda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No VIF found with MAC fa:16:3e:43:a3:7d, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:31:57 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:31:57 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:31:57 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:31:57</nova:creationTime>
Nov 14 06:31:57 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:31:57 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:31:57 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:31:57 user nova-compute[75354]:   <nova:owner>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:31:57 user nova-compute[75354]:   </nova:owner>
Nov 14 06:31:57 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:31:57 user nova-compute[75354]:   <nova:ports>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:31:57 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:31:57 user nova-compute[75354]:     </nova:port>
Nov 14 06:31:57 user nova-compute[75354]:     <nova:port uuid="d191d6b3-6ebb-460f-8403-49eb5a9fc0ca">
Nov 14 06:31:57 user nova-compute[75354]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Nov 14 06:31:57 user nova-compute[75354]:     </nova:port>
Nov 14 06:31:57 user nova-compute[75354]:   </nova:ports>
Nov 14 06:31:57 user nova-compute[75354]: </nova:instance>
Nov 14 06:31:57 user nova-compute[75354]:  {{(pid=75354) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updated VIF entry in instance network info cache for port d191d6b3-6ebb-460f-8403-49eb5a9fc0ca. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdc06c84-66fd-4c75-bfb4-4d46f1cdb3b5 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "interface-6b2df786-b4e7-4593-b73b-4ee8d54f92e6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.898s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-18991ce9-57f4-4c1d-be45-c9fbbd847da1 req-b7ffddbd-7ad5-46fb-a3d0-a65c2afc3d58 service nova] Releasing lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG nova.objects.instance [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'flavor' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:57 user nova-compute[75354]: INFO nova.compute.manager [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Attaching volume 394ecc71-adae-4484-bcda-389f47cdd38b to /dev/vdb
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.utils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1642d82-3954-4239-b973-3941905c6d15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3604e-9b10-40af-bd6e-321c40208976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a84f9a6-9ee7-439f-b094-02638cc13da2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8971840-7f70-48e9-b77a-028787b23698]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:31:58 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49c6c8-b011-4870-a8c6-454076b270a7]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.utils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating existing volume attachment record: a9e749ea-b586-4e18-aa42-444c09bc96ed {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-changed-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Refreshing instance network info cache due to event network-changed-906df1dc-5f74-42b1-b5bf-97d24850db6f. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] Acquiring lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] Acquired lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.network.neutron [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Refreshing network info cache for port 906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:58 user nova-compute[75354]: INFO nova.compute.manager [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Detaching volume e074f541-ed81-43a0-baf9-7d5709cb8d2f
Nov 14 06:31:58 user nova-compute[75354]: INFO nova.virt.block_device [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Attempting to driver detach volume e074f541-ed81-43a0-baf9-7d5709cb8d2f from mountpoint /dev/vdb
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Attempting to detach device vdb from instance b96beb17-09e1-45a2-8699-8657baa034e8 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:31:58 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:31:58 user nova-compute[75354]:   <source dev="/dev/sdi"/>
Nov 14 06:31:58 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:31:58 user nova-compute[75354]:   <serial>e074f541-ed81-43a0-baf9-7d5709cb8d2f</serial>
Nov 14 06:31:58 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:31:58 user nova-compute[75354]: </disk>
Nov 14 06:31:58 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:31:58 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Successfully detached device vdb from instance b96beb17-09e1-45a2-8699-8657baa034e8 from the persistent domain config.
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b96beb17-09e1-45a2-8699-8657baa034e8 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:31:58 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:31:58 user nova-compute[75354]:   <source dev="/dev/sdi"/>
Nov 14 06:31:58 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:31:58 user nova-compute[75354]:   <serial>e074f541-ed81-43a0-baf9-7d5709cb8d2f</serial>
Nov 14 06:31:58 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:31:58 user nova-compute[75354]: </disk>
Nov 14 06:31:58 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABFiPHyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:31:58 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:58 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:31:58 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76220df2-3d7d-400c-b777-3818e88ccada]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:31:58 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf672b82-d2f0-424d-a360-d59037d30264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e] added
Nov 14 06:31:58 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e2fc0-ec94-45d8-bbb9-a5391dc0d09b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updated VIF entry in instance network info cache for port 906df1dc-5f74-42b1-b5bf-97d24850db6f. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating instance_info_cache with network_info: [{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f89cc-a283-464b-bb8a-a58adabe28e8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2beb8845-4c4e-446e-ba43-8a2ba0f9028c req-f4b464c5-bc90-4d89-bbda-2be1b2611273 service nova] Releasing lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ABFiPHyg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ABFiPHyg" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ce1fe-9472-4a32-93eb-5d8805ea7475]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ABFiPHyg'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-1cca4ac8-4d47-4d3d-b1e4-3ac67176016e req-aae23799-397d-42ca-9b8f-e19f292336bc service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cca4ac8-4d47-4d3d-b1e4-3ac67176016e req-aae23799-397d-42ca-9b8f-e19f292336bc service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cca4ac8-4d47-4d3d-b1e4-3ac67176016e req-aae23799-397d-42ca-9b8f-e19f292336bc service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cca4ac8-4d47-4d3d-b1e4-3ac67176016e req-aae23799-397d-42ca-9b8f-e19f292336bc service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-1cca4ac8-4d47-4d3d-b1e4-3ac67176016e req-aae23799-397d-42ca-9b8f-e19f292336bc service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:31:59 user nova-compute[75354]: WARNING nova.compute.manager [req-1cca4ac8-4d47-4d3d-b1e4-3ac67176016e req-aae23799-397d-42ca-9b8f-e19f292336bc service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca for instance with vm_state active and task_state None.
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[25faabbe-a3dc-464f-80e4-4883690bc8d7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ae298-b890-4f25-9317-9d3be6f9cbb5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b96beb17-09e1-45a2-8699-8657baa034e8 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0738c-687a-4c35-a04b-e9058abf6cca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260]
Nov 14 06:31:59 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260] successful.
Nov 14 06:31:59 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b310055-b919-4679-b2ee-26315702f4e0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83ec716-157c-4fb4-9fad-2353927ab7b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:31:59 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:31:59 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4badac3e-affd-4588-90ea-30d169df97c7]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABFiPHyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:31:59 user nova-compute[75354]: INFO nova.compute.manager [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Rebuilding instance
Nov 14 06:31:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:31:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-7b36a83c-ec33-4cf2-a6fa-edfacf94e69e req-7299e92f-4dc0-476b-84b8-b149a891116f service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-unplugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7b36a83c-ec33-4cf2-a6fa-edfacf94e69e req-7299e92f-4dc0-476b-84b8-b149a891116f service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7b36a83c-ec33-4cf2-a6fa-edfacf94e69e req-7299e92f-4dc0-476b-84b8-b149a891116f service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7b36a83c-ec33-4cf2-a6fa-edfacf94e69e req-7299e92f-4dc0-476b-84b8-b149a891116f service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-7b36a83c-ec33-4cf2-a6fa-edfacf94e69e req-7299e92f-4dc0-476b-84b8-b149a891116f service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-unplugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:00 user nova-compute[75354]: WARNING nova.compute.manager [req-7b36a83c-ec33-4cf2-a6fa-edfacf94e69e req-7299e92f-4dc0-476b-84b8-b149a891116f service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-unplugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state rebuilding.
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26631613132313835', 'path': '/dev/sdk'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613132313835', 'path': '/dev/sdk'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lazy-loading 'flavor' on Instance uuid 1fc570b9-a592-425d-9c84-b67a7a37e07f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:32:00 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:00 user nova-compute[75354]:   <source dev="/dev/sdk"/>
Nov 14 06:32:00 user nova-compute[75354]:   <target dev="sdc" bus="scsi"/>
Nov 14 06:32:00 user nova-compute[75354]:   <serial>cf7e461d-8bcd-46a4-b8a4-84903a77db6e</serial>
Nov 14 06:32:00 user nova-compute[75354]:   <address type="drive" controller="0" unit="2"/>
Nov 14 06:32:00 user nova-compute[75354]: </disk>
Nov 14 06:32:00 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:32:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance destroyed successfully.
Nov 14 06:32:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance destroyed successfully.
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-170243607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2097679557',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+U3sLOre+F5aoiCDKzHyv9ZTfTl812MaliLoYlPWTQ62vXFOp6v+jH/QM0j4JEuXeCOVF2NnI+RHNMb3Q/SAd3L0i/qEX0Ssw/kKVMRBXrQMIpN0cAzNOwCP4hnqSaA==',key_name='tempest-keypair-1519457139',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e074784c3da44c8b4c2c97972f1d94b',ramdisk_id='',reservation_id='r-brr8bk9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2126097574',owner_user_name='tempest-ServerActionsV293TestJSON-2126097574-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='332071a34d4c44ed8529fe3431ead3c1',uuid=93429017-a737-45d4-965b-d7369a440bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converting VIF {"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap906df1dc-5f, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4627337b-cf6b-4e8a-940d-80a2d480e425) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:00 user nova-compute[75354]: INFO os_vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f')
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:00 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33dfbb2-bff8-4ba1-b565-a4e10fbaf03c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:00 user nova-compute[75354]: No targets found.
Nov 14 06:32:00 user nova-compute[75354]: iSNS:
Nov 14 06:32:00 user nova-compute[75354]: No targets found.
Nov 14 06:32:00 user nova-compute[75354]: STATIC:
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:32:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:00 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:00 user nova-compute[75354]: No targets found.
Nov 14 06:32:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:00 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:00 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf078e-20e4-4383-b35d-ad6165b6ffe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No BDM found with device name sda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] No VIF found with MAC fa:16:3e:19:77:d2, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8eea43-1196-463f-990d-fb8f408151dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:00 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809417dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4f77d2-afa6-4a1d-a298-6d4848bacebc]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57705ba-8ff5-4b11-ae38-d1c3c99d8773]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee398ecf-d95b-4382-83f0-e412b19d6322]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6152999-005c-426e-b3d5-3c73a2e08749]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1388a21c-0f51-4ef1-aca6-4f3e8b95b49c tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.068s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab115a1-9d55-43be-a8fd-4b220922b06f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[adedf777-2caf-45e9-aac2-3b59022ebb19]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]
Nov 14 06:32:01 user nova-compute[75354]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3001bcec-a143-45c2-ba75-2cd10006b980]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== disconnect_volume: return (350ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Deleting instance files /opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8_del
Nov 14 06:32:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Deletion of /opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8_del complete
Nov 14 06:32:01 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 93429017-a737-45d4-965b-d7369a440bf8 could not be found.
Nov 14 06:32:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:01 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06e783-e4a6-4b09-be3e-3225cd27482c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:01 user nova-compute[75354]: No targets found.
Nov 14 06:32:01 user nova-compute[75354]: iSNS:
Nov 14 06:32:01 user nova-compute[75354]: No targets found.
Nov 14 06:32:01 user nova-compute[75354]: STATIC:
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:32:01 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:01 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:01 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:01 user nova-compute[75354]: No targets found.
Nov 14 06:32:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:01 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:01 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c2aa5f-4d1c-488a-9337-5c41c56e742b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a821c-1489-4494-b7df-83966d46ae0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:01 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809410e950>, {}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Disconnecting from: [] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== disconnect_volume: return (84ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:02 user nova-compute[75354]: INFO nova.compute.manager [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Detaching volume cf7e461d-8bcd-46a4-b8a4-84903a77db6e
Nov 14 06:32:02 user nova-compute[75354]: INFO nova.virt.block_device [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Attempting to driver detach volume cf7e461d-8bcd-46a4-b8a4-84903a77db6e from mountpoint /dev/sdc
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Attempting to detach device sdc from instance 1fc570b9-a592-425d-9c84-b67a7a37e07f from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:02 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:02 user nova-compute[75354]:   <source dev="/dev/sdk"/>
Nov 14 06:32:02 user nova-compute[75354]:   <target dev="sdc" bus="scsi"/>
Nov 14 06:32:02 user nova-compute[75354]:   <serial>cf7e461d-8bcd-46a4-b8a4-84903a77db6e</serial>
Nov 14 06:32:02 user nova-compute[75354]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 06:32:02 user nova-compute[75354]: </disk>
Nov 14 06:32:02 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Successfully detached device sdc from instance 1fc570b9-a592-425d-9c84-b67a7a37e07f from the persistent domain config.
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1fc570b9-a592-425d-9c84-b67a7a37e07f from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:02 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:02 user nova-compute[75354]:   <source dev="/dev/sdk"/>
Nov 14 06:32:02 user nova-compute[75354]:   <target dev="sdc" bus="scsi"/>
Nov 14 06:32:02 user nova-compute[75354]:   <serial>cf7e461d-8bcd-46a4-b8a4-84903a77db6e</serial>
Nov 14 06:32:02 user nova-compute[75354]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 06:32:02 user nova-compute[75354]: </disk>
Nov 14 06:32:02 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-16d2dea5-f11d-4760-8982-ac9bf459ebd4 req-cf8da3aa-1b0f-450f-94a6-6d67ee902691 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-16d2dea5-f11d-4760-8982-ac9bf459ebd4 req-cf8da3aa-1b0f-450f-94a6-6d67ee902691 service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-16d2dea5-f11d-4760-8982-ac9bf459ebd4 req-cf8da3aa-1b0f-450f-94a6-6d67ee902691 service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-16d2dea5-f11d-4760-8982-ac9bf459ebd4 req-cf8da3aa-1b0f-450f-94a6-6d67ee902691 service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-16d2dea5-f11d-4760-8982-ac9bf459ebd4 req-cf8da3aa-1b0f-450f-94a6-6d67ee902691 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:02 user nova-compute[75354]: WARNING nova.compute.manager [req-16d2dea5-f11d-4760-8982-ac9bf459ebd4 req-cf8da3aa-1b0f-450f-94a6-6d67ee902691 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state rebuilding.
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Preparing to wait for external event volume-reimaged-e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 {{(pid=75354) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1fc570b9-a592-425d-9c84-b67a7a37e07f {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfzWNetj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:03 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:03 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:03 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d9ecc0-1906-4ca3-856a-0bb4a9f989b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:32:03 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a129579-f41e-4483-b2f7-7b050a059eb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b] added
Nov 14 06:32:03 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ca0f37-fe29-47cf-a9ab-93a2e00534d2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35381f0-aa21-462d-bd6d-ad7bcbd617a0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfzWNetj {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfzWNetj" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45460eb-d8b0-4bd8-9b12-c30d5ebb1cae]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfzWNetj'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb0c3e1-17b8-4a9d-a736-3cb6fd102b6e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[df481892-56e3-4f7f-9dfe-589273263f61]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc75d5d-816e-4efb-a5ec-a4d4d6ad2127]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260]
Nov 14 06:32:03 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:03 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9dd1c6-3216-49dc-a625-985da7410268]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f600d64-b361-466a-b171-66b4911d3f2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:03 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:03 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704229f-c717-447d-bcb5-0656e4b97c21]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:32:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfzWNetj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-changed-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Refreshing instance network info cache due to event network-changed-924b8fb4-50d6-4ec2-a462-8395186b525a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] Acquiring lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] Acquired lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Refreshing network info cache for port 924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updated VIF entry in instance network info cache for port 924b8fb4-50d6-4ec2-a462-8395186b525a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updating instance_info_cache with network_info: [{"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-53d2dd68-73c1-43e4-a605-07247886d6d1 req-6b0be3d4-ce89-4093-af14-5440aff16a67 service nova] Releasing lock "refresh_cache-9677bd15-7e09-41db-8f75-0da15ac5d426" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26137653135323263', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137653135323263', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.objects.instance [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'flavor' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:32:04 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:04 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:32:04 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:04 user nova-compute[75354]:   <serial>394ecc71-adae-4484-bcda-389f47cdd38b</serial>
Nov 14 06:32:04 user nova-compute[75354]: </disk>
Nov 14 06:32:04 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:32:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No BDM found with device name hda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] No VIF found with MAC fa:16:3e:43:a3:7d, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:32:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088605e8-502f-459d-b744-414a30f636ca tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.452s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:06 user nova-compute[75354]: INFO nova.compute.manager [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Detaching volume 394ecc71-adae-4484-bcda-389f47cdd38b
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:06 user nova-compute[75354]: INFO nova.virt.block_device [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Attempting to driver detach volume 394ecc71-adae-4484-bcda-389f47cdd38b from mountpoint /dev/vdb
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.objects.instance [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lazy-loading 'flavor' on Instance uuid 9677bd15-7e09-41db-8f75-0da15ac5d426 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Attempting to detach device vdb from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:06 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:06 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:32:06 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:06 user nova-compute[75354]:   <serial>394ecc71-adae-4484-bcda-389f47cdd38b</serial>
Nov 14 06:32:06 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 06:32:06 user nova-compute[75354]: </disk>
Nov 14 06:32:06 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully detached device vdb from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the persistent domain config.
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:06 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:06 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:32:06 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:06 user nova-compute[75354]:   <serial>394ecc71-adae-4484-bcda-389f47cdd38b</serial>
Nov 14 06:32:06 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 06:32:06 user nova-compute[75354]: </disk>
Nov 14 06:32:06 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:06 user nova-compute[75354]: INFO nova.compute.manager [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Attaching volume 8e251dac-643d-4d5f-a1b7-a1c5a606608d to /dev/vdb
Nov 14 06:32:06 user nova-compute[75354]: DEBUG os_brick.utils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2159f47-b6a5-4962-98f3-dbb0763c87d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dbcf16-171e-40aa-b6f9-c6d17f6f2052]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8848b36a-04bc-40db-ad78-2dc79ce8cb98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78d2d2-5255-4f8b-9b88-a26883e3329b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:32:06 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:32:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bdf67-5b3e-4a75-8406-71d7541d9b0f]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG os_brick.utils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updating existing volume attachment record: 09a93949-2bdf-4eb0-8f2b-e2cad80061b8 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:32:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:32:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-changed-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Refreshing instance network info cache due to event network-changed-de150d79-f1d1-4f35-9cd8-e7fef54c20c1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] Acquiring lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] Acquired lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG nova.network.neutron [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Refreshing network info cache for port de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lazy-loading 'flavor' on Instance uuid 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG nova.network.neutron [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updated VIF entry in instance network info cache for port de150d79-f1d1-4f35-9cd8-e7fef54c20c1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG nova.network.neutron [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updating instance_info_cache with network_info: [{"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1eedf74a-45d5-4b9b-af49-5166cb150cbc req-b42e5eab-9de0-4713-a47e-8eafe060ebfd service nova] Releasing lock "refresh_cache-3ef09cb8-e642-4810-a2fe-aa4d79c055c4" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:10 user nova-compute[75354]: INFO nova.compute.manager [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Attaching volume e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 to /dev/vdb
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.utils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fee8e5-e32f-4871-85ff-f3bcaf33db7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1364d3dd-0ebf-42d7-b9e0-589a952a81d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7353ca8-9bfc-4097-a805-a0285cd8e769]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a3b8ce-f5d0-49fa-b5d5-4c821f5b04fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:32:11 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f5136-e645-4122-bcf5-ba1eea097321]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.utils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updating existing volume attachment record: d8bf0ed9-7337-40d3-a4a0-fb841a14974f {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUbHNTqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:11 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be80041-a12d-4957-9231-d2be99ad874e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:32:11 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[be29d952-1ef9-4ebe-a4e7-db3055cd9e60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d] added
Nov 14 06:32:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a74932-1c74-4912-bf9f-418141c476c6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9676e-3ecd-45c5-8176-82597b1cf0fb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUbHNTqy {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUbHNTqy" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade44e65-1206-4702-afe6-2a0db4e5a361]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sUbHNTqy'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df70a3-66a7-4c49-aaa9-e059c8858525]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1fb362-12ac-47a8-879b-32fb170f0c7f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd62ee-e9bb-4b93-ba5b-9e05e8184e0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260]
Nov 14 06:32:11 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cf2769-0428-4e35-aab3-f5c7e21bac14]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c47ee66-6750-47ad-936d-17ac6563cb88]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:11 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] HCTL ('44', '-', '-', 0) found on session 17 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.147s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[135505c2-d7e9-41ab-9165-f3f4c3519c0b]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Searching for a device in session 17 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:32:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUbHNTqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:32:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '23830376162666434', 'path': '/dev/sdm'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830376162666434', 'path': '/dev/sdm'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:32:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lazy-loading 'flavor' on Instance uuid 9677bd15-7e09-41db-8f75-0da15ac5d426 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:32:12 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:12 user nova-compute[75354]:   <source dev="/dev/sdm"/>
Nov 14 06:32:12 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:12 user nova-compute[75354]:   <serial>8e251dac-643d-4d5f-a1b7-a1c5a606608d</serial>
Nov 14 06:32:12 user nova-compute[75354]: </disk>
Nov 14 06:32:12 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:32:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] No VIF found with MAC fa:16:3e:c2:c8:76, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:32:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-60b4a14b-0279-4f91-97b3-6e9cf0622a4f tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.065s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-f519847a-4eff-4b5a-8515-37b59417441e req-36f942e8-7dc7-495f-80e6-9efb0ff647ad service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event volume-reimaged-e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f519847a-4eff-4b5a-8515-37b59417441e req-36f942e8-7dc7-495f-80e6-9efb0ff647ad service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f519847a-4eff-4b5a-8515-37b59417441e req-36f942e8-7dc7-495f-80e6-9efb0ff647ad service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f519847a-4eff-4b5a-8515-37b59417441e req-36f942e8-7dc7-495f-80e6-9efb0ff647ad service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-f519847a-4eff-4b5a-8515-37b59417441e req-36f942e8-7dc7-495f-80e6-9efb0ff647ad service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Processing event volume-reimaged-e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 06:32:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance event wait completed in 12 seconds for volume-reimaged {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:32:14 user nova-compute[75354]: INFO nova.virt.block_device [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Booting with volume e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 at /dev/vda
Nov 14 06:32:15 user nova-compute[75354]: DEBUG os_brick.utils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffa8c6-da48-4e0b-8c2e-4321962ece0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0684b3c-7aa7-4795-8ab0-50562c62588d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309e08c-b7e5-45c7-8e4f-d4a6da11ee73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5dea5-6141-429f-abee-df26f4f5973b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:32:15 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dbfeca-066e-445f-a050-7faf6fcd347a]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG os_brick.utils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating existing volume attachment record: e501e7e6-ced2-46a1-aec7-6511915f188a {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:15 user nova-compute[75354]: INFO nova.compute.manager [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Detaching volume 8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:15 user nova-compute[75354]: INFO nova.virt.block_device [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Attempting to driver detach volume 8e251dac-643d-4d5f-a1b7-a1c5a606608d from mountpoint /dev/vdb
Nov 14 06:32:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Attempting to detach device vdb from instance 9677bd15-7e09-41db-8f75-0da15ac5d426 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:15 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:15 user nova-compute[75354]:   <source dev="/dev/sdm"/>
Nov 14 06:32:15 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:15 user nova-compute[75354]:   <serial>8e251dac-643d-4d5f-a1b7-a1c5a606608d</serial>
Nov 14 06:32:15 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:32:15 user nova-compute[75354]: </disk>
Nov 14 06:32:15 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Successfully detached device vdb from instance 9677bd15-7e09-41db-8f75-0da15ac5d426 from the persistent domain config.
Nov 14 06:32:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9677bd15-7e09-41db-8f75-0da15ac5d426 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:15 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:15 user nova-compute[75354]:   <source dev="/dev/sdm"/>
Nov 14 06:32:15 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:15 user nova-compute[75354]:   <serial>8e251dac-643d-4d5f-a1b7-a1c5a606608d</serial>
Nov 14 06:32:15 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:32:15 user nova-compute[75354]: </disk>
Nov 14 06:32:15 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9677bd15-7e09-41db-8f75-0da15ac5d426 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:32:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNosmdAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:16 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:16 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:16 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9a885-2497-47af-bb77-386c07fa7fdf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:32:16 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0954c23a-27a5-404d-9c13-9f1503c53d1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3] added
Nov 14 06:32:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.101s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852702c-7343-4e12-8cd9-21dcf5235854]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d2ab75-5a21-4bd7-8226-4a166f3469c7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNosmdAQ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNosmdAQ" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c6bcf2-d199-4946-94a1-4365d444571f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNosmdAQ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7bad2e-f1c3-4fa6-bdc6-44e88f896776]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e5db7d-27d0-47c5-96d0-0a8d9ecdfc1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff5359-5c97-43b7-9f29-df634cb959f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260]
Nov 14 06:32:16 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46430d71-9db9-4920-bc63-a34217374fff]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54a30e5-7a2a-4f16-9379-9f04fa7bb1eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:16 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] HCTL ('43', '-', '-', 0) found on session 18 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e4f310-1504-404c-a0af-7d1fd71f0266]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Searching for a device in session 18 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:32:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNosmdAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26532623164333438', 'path': '/dev/sdl'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532623164333438', 'path': '/dev/sdl'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lazy-loading 'flavor' on Instance uuid 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 06:32:17 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:17 user nova-compute[75354]:   <source dev="/dev/sdl"/>
Nov 14 06:32:17 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:17 user nova-compute[75354]:   <serial>e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3</serial>
Nov 14 06:32:17 user nova-compute[75354]: </disk>
Nov 14 06:32:17 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-changed-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing instance network info cache due to event network-changed-910b8cb8-aaf7-4582-9d9d-47d08025d4d8. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] Acquiring lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] Acquired lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:17 user nova-compute[75354]: DEBUG nova.network.neutron [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Refreshing network info cache for port 910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] No VIF found with MAC fa:16:3e:8a:81:de, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f722714-445c-4cf3-a803-156fa850d325 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.213s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.network.neutron [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updated VIF entry in instance network info cache for port 910b8cb8-aaf7-4582-9d9d-47d08025d4d8. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.network.neutron [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [{"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7d9eb8ba-3091-487c-b59b-01daf91ba330 req-20963706-216b-4af4-8d75-cd5efa27b908 service nova] Releasing lock "refresh_cache-6379bb6f-54d6-4af9-bd98-f9d177676f33" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] volume_snapshot_create: create_info: {'snapshot_id': 'a66674bd-ef67-443d-93e2-9f52e132d215', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75354) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] snap xml: <domainsnapshot>
Nov 14 06:32:18 user nova-compute[75354]:   <disks>
Nov 14 06:32:18 user nova-compute[75354]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 14 06:32:18 user nova-compute[75354]:       <source file="/dev/new_file"/>
Nov 14 06:32:18 user nova-compute[75354]:     </disk>
Nov 14 06:32:18 user nova-compute[75354]:     <disk name="vda" snapshot="no"/>
Nov 14 06:32:18 user nova-compute[75354]:   </disks>
Nov 14 06:32:18 user nova-compute[75354]: </domainsnapshot>
Nov 14 06:32:18 user nova-compute[75354]:  {{(pid=75354) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 06:32:18 user nova-compute[75354]: DEBUG nova.objects.instance [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] Lazy-loading 'system_metadata' on Instance uuid 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:19 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     rv = execute(f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     six.reraise(c, e, tb)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     raise value
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     rv = meth(*args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     self._volume_snapshot_create(context, instance, guest,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     rv = execute(f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     six.reraise(c, e, tb)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     raise value
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     rv = meth(*args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] 
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-512f0ba4-e59b-4a81-9ae8-b53220a2330d tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] volume_snapshot_delete: delete_info: {'volume_id': 'e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3'} {{(pid=75354) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [None req-512f0ba4-e59b-4a81-9ae8-b53220a2330d tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4]     if delete_info['type'] != 'qcow2':
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] KeyError: 'type'
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a66674bd-ef67-443d-93e2-9f52e132d215 could not be found.
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a66674bd-ef67-443d-93e2-9f52e132d215 could not be found. (HTTP 404) (Request-ID: req-653b372b-f5b0-4d1a-a6c4-cf0a7ab79bba)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a66674bd-ef67-443d-93e2-9f52e132d215 could not be found.
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server [None req-509b01c3-a33e-4efc-a1a4-637ae968fc25 tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server 
Nov 14 06:32:19 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b96beb17-09e1-45a2-8699-8657baa034e8 is timed out.
Nov 14 06:32:19 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Successfully detached device vdb from instance b96beb17-09e1-45a2-8699-8657baa034e8 from the live domain config.
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver [None req-512f0ba4-e59b-4a81-9ae8-b53220a2330d tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-247ceae9-3fe5-42be-bce6-dd6d0a84945e)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 06:32:19 user nova-compute[75354]: ERROR nova.virt.libvirt.driver 
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server [None req-512f0ba4-e59b-4a81-9ae8-b53220a2330d tempest-VolumesAssistedSnapshotsTest-757950531 tempest-VolumesAssistedSnapshotsTest-757950531-project] Exception during message handling: KeyError: 'type'
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 06:32:19 user nova-compute[75354]: ERROR oslo_messaging.rpc.server 
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZuKCXbOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:19 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc0e331-1613-48e7-9c8b-0683e7836556]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:19 user nova-compute[75354]: No targets found.
Nov 14 06:32:19 user nova-compute[75354]: iSNS:
Nov 14 06:32:19 user nova-compute[75354]: No targets found.
Nov 14 06:32:19 user nova-compute[75354]: STATIC:
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:32:19 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:19 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:19 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:19 user nova-compute[75354]: No targets found.
Nov 14 06:32:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:19 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:19 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3acd724-e9ed-4637-86dc-ca5b8e6e89f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab496a61-ec09-4656-9f90-f2117e2b88ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:19 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80a14d3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f'): ({'sdi'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Removing single pathed devices sdi {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[08faf023-6dfd-49d4-90ca-d81f5d5680dc]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c34630-27b9-402a-be75-b94a2f42c28c]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Flushing IO for device /dev/sdi {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f18ed-cccd-46e8-afaa-1a0e254fbc2b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74975cb-eb10-4311-bdfd-a07e260f5763]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] SCSI volumes sdi have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a4db0-231c-4654-82c4-1b7a29f377e3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: INFO nova.compute.manager [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Detaching volume e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2fdf33-34de-482d-ba60-793227b2ba1a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260]
Nov 14 06:32:19 user nova-compute[75354]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e074f541-ed81-43a0-baf9-7d5709cb8d2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddd692-70a7-42cd-a146-8df6eceaf3ce]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] <== disconnect_volume: return (377ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:19 user nova-compute[75354]: INFO nova.virt.block_device [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Attempting to driver detach volume e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 from mountpoint /dev/vdb
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Attempting to detach device vdb from instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:19 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:19 user nova-compute[75354]:   <source dev="/dev/sdl"/>
Nov 14 06:32:19 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:19 user nova-compute[75354]:   <serial>e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3</serial>
Nov 14 06:32:19 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:32:19 user nova-compute[75354]: </disk>
Nov 14 06:32:19 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-changed-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing instance network info cache due to event network-changed-75a319db-14c0-4114-9c6e-d818fafe8e84. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] Acquiring lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] Acquired lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.network.neutron [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Refreshing network info cache for port 75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:32:19 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Successfully detached device vdb from instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 from the persistent domain config.
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:32:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 06:32:19 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:19 user nova-compute[75354]:   <source dev="/dev/sdl"/>
Nov 14 06:32:19 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:32:19 user nova-compute[75354]:   <serial>e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3</serial>
Nov 14 06:32:19 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:32:19 user nova-compute[75354]: </disk>
Nov 14 06:32:19 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:32:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Creating image(s)
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Ensure instance console log exists: /opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Start _get_guest_xml network_info=[{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93429017-a737-45d4-965b-d7369a440bf8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'serial': 'e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'e501e7e6-ced2-46a1-aec7-6511915f188a', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:32:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 06:32:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93429017-a737-45d4-965b-d7369a440bf8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:20 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:20 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:20 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.network.neutron [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updated VIF entry in instance network info cache for port 75a319db-14c0-4114-9c6e-d818fafe8e84. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.network.neutron [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3337466-f8a1-409a-b147-b890b17afd20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:32:20 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8195e5a3-6da1-4c19-8151-8bf141535df1 req-4684141f-12e9-4efc-b7b4-60ebc3fe4229 service nova] Releasing lock "refresh_cache-0227dd34-937e-4079-a37d-ef3cbc39fcf7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[49624045-4600-4570-9cd3-eb1af48e015a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1] added
Nov 14 06:32:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9344fb-027a-45fa-84e4-ab9e9038189f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e4469-9d36-4c35-9bff-f1190997a93b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZCALYJQ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZCALYJQ" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3787e2b-1293-4b76-8615-d5770e198d6f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZCALYJQ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[57baae2a-a4ec-4682-b5a6-a3062bf3cd8f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8ed024-2560-40db-a780-3579bdae08b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.objects.instance [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'flavor' on Instance uuid b96beb17-09e1-45a2-8699-8657baa034e8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067e4a6-ce5f-4139-9ec3-afa86c7fb427]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]
Nov 14 06:32:20 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68e1aef3-0ff3-4ad6-95bc-a7769dba677d tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c91892-f4c7-4646-9f1b-223149e350f5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc87f39-ca12-4b7d-b663-5be65e56d3a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:20 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde7d77-e505-4ec0-9741-ebc7649534bc]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:20 user nova-compute[75354]: INFO nova.compute.manager [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Terminating instance
Nov 14 06:32:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26461613033323332', 'path': '/dev/sdi'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461613033323332', 'path': '/dev/sdi'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-170243607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2097679557',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+U3sLOre+F5aoiCDKzHyv9ZTfTl812MaliLoYlPWTQ62vXFOp6v+jH/QM0j4JEuXeCOVF2NnI+RHNMb3Q/SAd3L0i/qEX0Ssw/kKVMRBXrQMIpN0cAzNOwCP4hnqSaA==',key_name='tempest-keypair-1519457139',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e074784c3da44c8b4c2c97972f1d94b',ramdisk_id='',reservation_id='r-brr8bk9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2126097574',owner_user_name='tempest-ServerActionsV293TestJSON-2126097574-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='332071a34d4c44ed8529fe3431ead3c1',uuid=93429017-a737-45d4-965b-d7369a440bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converting VIF {"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:32:21 user nova-compute[75354]:   <uuid>93429017-a737-45d4-965b-d7369a440bf8</uuid>
Nov 14 06:32:21 user nova-compute[75354]:   <name>instance-00000007</name>
Nov 14 06:32:21 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:32:21 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:32:21 user nova-compute[75354]:   <metadata>
Nov 14 06:32:21 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:21 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:32:21 user nova-compute[75354]:       <nova:name>tempest-ServerActionsV293TestJSON-server-170243607</nova:name>
Nov 14 06:32:21 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:32:20</nova:creationTime>
Nov 14 06:32:21 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:32:21 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:21 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:32:21 user nova-compute[75354]:       <nova:owner>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:user uuid="332071a34d4c44ed8529fe3431ead3c1">tempest-ServerActionsV293TestJSON-2126097574-project-member</nova:user>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:project uuid="3e074784c3da44c8b4c2c97972f1d94b">tempest-ServerActionsV293TestJSON-2126097574</nova:project>
Nov 14 06:32:21 user nova-compute[75354]:       </nova:owner>
Nov 14 06:32:21 user nova-compute[75354]:       <nova:ports>
Nov 14 06:32:21 user nova-compute[75354]:         <nova:port uuid="906df1dc-5f74-42b1-b5bf-97d24850db6f">
Nov 14 06:32:21 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:32:21 user nova-compute[75354]:         </nova:port>
Nov 14 06:32:21 user nova-compute[75354]:       </nova:ports>
Nov 14 06:32:21 user nova-compute[75354]:     </nova:instance>
Nov 14 06:32:21 user nova-compute[75354]:   </metadata>
Nov 14 06:32:21 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:32:21 user nova-compute[75354]:     <system>
Nov 14 06:32:21 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:32:21 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:32:21 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:32:21 user nova-compute[75354]:       <entry name="serial">93429017-a737-45d4-965b-d7369a440bf8</entry>
Nov 14 06:32:21 user nova-compute[75354]:       <entry name="uuid">93429017-a737-45d4-965b-d7369a440bf8</entry>
Nov 14 06:32:21 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:32:21 user nova-compute[75354]:     </system>
Nov 14 06:32:21 user nova-compute[75354]:   </sysinfo>
Nov 14 06:32:21 user nova-compute[75354]:   <os>
Nov 14 06:32:21 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:32:21 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:32:21 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:32:21 user nova-compute[75354]:   </os>
Nov 14 06:32:21 user nova-compute[75354]:   <features>
Nov 14 06:32:21 user nova-compute[75354]:     <acpi/>
Nov 14 06:32:21 user nova-compute[75354]:     <apic/>
Nov 14 06:32:21 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:32:21 user nova-compute[75354]:   </features>
Nov 14 06:32:21 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:32:21 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:32:21 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:32:21 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:32:21 user nova-compute[75354]:   </clock>
Nov 14 06:32:21 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:32:21 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:32:21 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:32:21 user nova-compute[75354]:   </cpu>
Nov 14 06:32:21 user nova-compute[75354]:   <devices>
Nov 14 06:32:21 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:32:21 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:32:21 user nova-compute[75354]:       <source dev="/dev/sdi"/>
Nov 14 06:32:21 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:32:21 user nova-compute[75354]:       <serial>e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1</serial>
Nov 14 06:32:21 user nova-compute[75354]:     </disk>
Nov 14 06:32:21 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:32:21 user nova-compute[75354]:       <mac address="fa:16:3e:b7:e1:db"/>
Nov 14 06:32:21 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:32:21 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:32:21 user nova-compute[75354]:       <target dev="tap906df1dc-5f"/>
Nov 14 06:32:21 user nova-compute[75354]:     </interface>
Nov 14 06:32:21 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:32:21 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8/console.log" append="off"/>
Nov 14 06:32:21 user nova-compute[75354]:     </serial>
Nov 14 06:32:21 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:32:21 user nova-compute[75354]:     <video>
Nov 14 06:32:21 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:32:21 user nova-compute[75354]:     </video>
Nov 14 06:32:21 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:32:21 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:32:21 user nova-compute[75354]:     </rng>
Nov 14 06:32:21 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:32:21 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:32:21 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:32:21 user nova-compute[75354]:     </memballoon>
Nov 14 06:32:21 user nova-compute[75354]:   </devices>
Nov 14 06:32:21 user nova-compute[75354]: </domain>
Nov 14 06:32:21 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-170243607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2097679557',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+U3sLOre+F5aoiCDKzHyv9ZTfTl812MaliLoYlPWTQ62vXFOp6v+jH/QM0j4JEuXeCOVF2NnI+RHNMb3Q/SAd3L0i/qEX0Ssw/kKVMRBXrQMIpN0cAzNOwCP4hnqSaA==',key_name='tempest-keypair-1519457139',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e074784c3da44c8b4c2c97972f1d94b',ramdisk_id='',reservation_id='r-brr8bk9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2126097574',owner_user_name='tempest-ServerActionsV293TestJSON-2126097574-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='332071a34d4c44ed8529fe3431ead3c1',uuid=93429017-a737-45d4-965b-d7369a440bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converting VIF {"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG os_vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d726e72d-2b99-4d29-ae29-0ad10360570d req-fdaf6999-b8c4-4372-ba09-75dae74cf5e1 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d726e72d-2b99-4d29-ae29-0ad10360570d req-fdaf6999-b8c4-4372-ba09-75dae74cf5e1 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d726e72d-2b99-4d29-ae29-0ad10360570d req-fdaf6999-b8c4-4372-ba09-75dae74cf5e1 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d726e72d-2b99-4d29-ae29-0ad10360570d req-fdaf6999-b8c4-4372-ba09-75dae74cf5e1 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d726e72d-2b99-4d29-ae29-0ad10360570d req-fdaf6999-b8c4-4372-ba09-75dae74cf5e1 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d726e72d-2b99-4d29-ae29-0ad10360570d req-fdaf6999-b8c4-4372-ba09-75dae74cf5e1 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99cc3ff9-7706-5950-8961-e55ae63d4781', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:21 user nova-compute[75354]: WARNING nova.compute.manager [req-3ca710bd-33a6-4991-8f26-3a398d81f7aa req-02566f2e-6379-4c89-ab3a-4f28ee0b44ad service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 for instance with vm_state active and task_state deleting.
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap906df1dc-5f, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap906df1dc-5f, col_values=(('qos', UUID('bff786e2-a30c-4d3f-8c09-1b8c3518237d')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap906df1dc-5f, col_values=(('external_ids', {'iface-id': '906df1dc-5f74-42b1-b5bf-97d24850db6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:e1:db', 'vm-uuid': '93429017-a737-45d4-965b-d7369a440bf8'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d8b417a-5ad8-40ca-a5c7-57d88d1adaba req-a5e0a110-e053-40f5-ba45-47d2de85ac12 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d8b417a-5ad8-40ca-a5c7-57d88d1adaba req-a5e0a110-e053-40f5-ba45-47d2de85ac12 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d8b417a-5ad8-40ca-a5c7-57d88d1adaba req-a5e0a110-e053-40f5-ba45-47d2de85ac12 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d8b417a-5ad8-40ca-a5c7-57d88d1adaba req-a5e0a110-e053-40f5-ba45-47d2de85ac12 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d8b417a-5ad8-40ca-a5c7-57d88d1adaba req-a5e0a110-e053-40f5-ba45-47d2de85ac12 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d8b417a-5ad8-40ca-a5c7-57d88d1adaba req-a5e0a110-e053-40f5-ba45-47d2de85ac12 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-cc3bee3c-7140-4685-8efd-47ef0114816e for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: INFO os_vif [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f')
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:22 user nova-compute[75354]: INFO nova.compute.manager [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Terminating instance
Nov 14 06:32:22 user nova-compute[75354]: DEBUG nova.compute.manager [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] No VIF found with MAC fa:16:3e:b7:e1:db, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1fc570b9-a592-425d-9c84-b67a7a37e07f is timed out.
Nov 14 06:32:22 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Successfully detached device sdc from instance 1fc570b9-a592-425d-9c84-b67a7a37e07f from the live domain config.
Nov 14 06:32:22 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABFiPHyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:22 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b791bf9-7841-4c05-b2ec-5c5393a18833]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:22 user nova-compute[75354]: No targets found.
Nov 14 06:32:22 user nova-compute[75354]: iSNS:
Nov 14 06:32:22 user nova-compute[75354]: No targets found.
Nov 14 06:32:22 user nova-compute[75354]: STATIC:
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:32:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:22 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:22 user nova-compute[75354]: No targets found.
Nov 14 06:32:22 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:22 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:22 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c21d7-b72d-4ba8-9a53-cd86c8e906d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.068s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab63a6f-121c-46d7-aeff-f7fe7daa3e90]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:22 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:22 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074467a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e'): ({'sdk'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Removing single pathed devices sdk {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d29529-f946-401f-8d79-7f7bcbcc1d93]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b9081a-a677-4b9b-b8e4-7071f188c165]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Flushing IO for device /dev/sdk {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb79eb98-f2aa-4b8e-a66f-e6188a139dd1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.065s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8908c7d-2245-4165-8f5f-224c3a402f3a]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] SCSI volumes sdk have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13fd48d-d173-4350-ad1e-6f2b350ce75a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddd9c8e-0760-400f-b411-fe3c52537dec]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260]
Nov 14 06:32:23 user nova-compute[75354]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7e461d-8bcd-46a4-b8a4-84903a77db6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c20e5a9-20d6-4a83-8602-4a3314c37c79]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.616s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] <== disconnect_volume: return (618ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-3fab9a2e-9617-4db7-8a44-0a91d944cc4e for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-75a319db-14c0-4114-9c6e-d818fafe8e84 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-75a319db-14c0-4114-9c6e-d818fafe8e84 for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-5211f59d-cc33-45b9-b15c-14304d99cefd req-671dec15-69e8-4837-b7c9-6778d81f2b9a service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-716e270f-6bc1-4f8a-9968-8de88db5f1e3 for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-2dc28cce-fb57-4770-bda6-3ab935236bbe for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-2dc28cce-fb57-4770-bda6-3ab935236bbe for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-5bcf9c47-838d-4b8a-b554-d7ce0f5325e7 for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-unplugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-unplugged-1de9f506-7108-4957-a83c-5d123c23899f for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-1de9f506-7108-4957-a83c-5d123c23899f for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:23 user nova-compute[75354]: WARNING nova.compute.manager [req-c66dacd4-6a10-44e4-ac62-c881dd88e234 req-a1a264b7-8c71-427a-b798-ef6922c206b4 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-2803bfd4-237d-4c4c-8bc1-ba3f06af623c for instance with vm_state active and task_state deleting.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Instance destroyed successfully.
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lazy-loading 'resources' on Instance uuid 6379bb6f-54d6-4af9-bd98-f9d177676f33 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap910b8cb8-aa, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lazy-loading 'flavor' on Instance uuid 1fc570b9-a592-425d-9c84-b67a7a37e07f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-86d10667-c740-4738-b6c7-aec9e051e8b3 tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.381s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66580553-714e-4434-97e2-a9c403d602c3) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Acquiring lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] No waiting events found dispatching network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:24 user nova-compute[75354]: WARNING nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received unexpected event network-vif-plugged-cc3bee3c-7140-4685-8efd-47ef0114816e for instance with vm_state active and task_state deleting.
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:24 user nova-compute[75354]: WARNING nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-c51db9d6-2363-4b49-a6ce-4f823ef56e15 for instance with vm_state active and task_state deleting.
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-35dddf93-0717-4cdd-9e27-939b3b74c58d for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:24 user nova-compute[75354]: WARNING nova.compute.manager [req-3f3d959d-d636-43cf-8c31-06062f4aefc3 req-e6db6674-6985-415c-89b3-f32d4b799912 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-35dddf93-0717-4cdd-9e27-939b3b74c58d for instance with vm_state active and task_state deleting.
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Instance destroyed successfully.
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lazy-loading 'resources' on Instance uuid 0227dd34-937e-4079-a37d-ef3cbc39fcf7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "75a319db-14c0-4114-9c6e-d818fafe8e84", "address": "fa:16:3e:2c:5c:1f", "network": {"id": "6aab68d9-e243-4197-84ca-eb128e733cd5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-606063095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a319db-14", "ovs_interfaceid": "75a319db-14c0-4114-9c6e-d818fafe8e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a319db-14, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8,network=Network(037e8bb0-f3ed-4dda-bb00-99eeb3137264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910b8cb8-aa')
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:24 user nova-compute[75354]: INFO nova.compute.manager [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Terminating instance
Nov 14 06:32:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dc28cce-fb, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d553faf7-a24e-47c1-a79e-c69d6fc8914c) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2532b974-4875-4708-88b2-564952dd85bd) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:25 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5c:1f,bridge_name='br-int',has_traffic_filtering=True,id=75a319db-14c0-4114-9c6e-d818fafe8e84,network=Network(6aab68d9-e243-4197-84ca-eb128e733cd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a319db-14')
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc51db9d6-23, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:25 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:62:3b,bridge_name='br-int',has_traffic_filtering=True,id=2dc28cce-fb57-4770-bda6-3ab935236bbe,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc28cce-fb')
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Instance destroyed successfully.
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.objects.instance [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lazy-loading 'resources' on Instance uuid 1fc570b9-a592-425d-9c84-b67a7a37e07f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1583428592',display_name='tempest-AttachSCSIVolumeTestJSON-server-1583428592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1583428592',id=5,image_ref='6f0e453a-f888-4932-a318-130e5df11192',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi6VRduYc1y1U62T+Gqo+UIBANIGwICeySLOrULBk6nw0eWnpf94ITGfBK3SIhpM3PVji82YkOVFESQ4JE9whbCMUHA/UKiD70uCfpE2tDBg23XfZTvQaVaDGpR5rfjrw==',key_name='tempest-keypair-2045799639',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='251bd7e1ce1b45afb4ba9b08e2cbc562',ramdisk_id='',reservation_id='r-8q50vs22',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f0e453a-f888-4932-a318-130e5df11192',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1162113736',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1162113736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efbe1f3eb5e2408f9b96751684d1a9a6',uuid=1fc570b9-a592-425d-9c84-b67a7a37e07f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Converting VIF {"id": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "address": "fa:16:3e:19:77:d2", "network": {"id": "dc4d1d74-b4d3-4d46-83c8-e48ee7326f21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-303462372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251bd7e1ce1b45afb4ba9b08e2cbc562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931719e-5e", "ovs_interfaceid": "6931719e-5eaf-4f1b-b88d-de1896c208fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG os_vif [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-5e42539c-cf41-4a30-89f3-2d8444a45857 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:25 user nova-compute[75354]: WARNING nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-5e42539c-cf41-4a30-89f3-2d8444a45857 for instance with vm_state active and task_state deleting.
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-unplugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-unplugged-96433f0d-9a51-4363-b14b-bc9a96836a2b for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Acquiring lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] No waiting events found dispatching network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:25 user nova-compute[75354]: WARNING nova.compute.manager [req-bfe2ab37-6f0b-46e1-961d-2bc94ceab24a req-bb35b290-7ad2-4f44-a414-15a36be03ab1 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received unexpected event network-vif-plugged-96433f0d-9a51-4363-b14b-bc9a96836a2b for instance with vm_state active and task_state deleting.
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-2314845d-eb94-44ff-b080-d8f215dc9d9a req-cde536ef-3518-4e10-b03e-b09edf94ac53 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-vif-unplugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2314845d-eb94-44ff-b080-d8f215dc9d9a req-cde536ef-3518-4e10-b03e-b09edf94ac53 service nova] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2314845d-eb94-44ff-b080-d8f215dc9d9a req-cde536ef-3518-4e10-b03e-b09edf94ac53 service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2314845d-eb94-44ff-b080-d8f215dc9d9a req-cde536ef-3518-4e10-b03e-b09edf94ac53 service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-2314845d-eb94-44ff-b080-d8f215dc9d9a req-cde536ef-3518-4e10-b03e-b09edf94ac53 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] No waiting events found dispatching network-vif-unplugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-2314845d-eb94-44ff-b080-d8f215dc9d9a req-cde536ef-3518-4e10-b03e-b09edf94ac53 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-vif-unplugged-6931719e-5eaf-4f1b-b88d-de1896c208fe for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bcf9c47-83, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb8b4757-7705-4f17-b8cb-60d8e83306ad) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6931719e-5e, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:35:c4,bridge_name='br-int',has_traffic_filtering=True,id=c51db9d6-2363-4b49-a6ce-4f823ef56e15,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51db9d6-23')
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d4aee96-540b-42fa-bef1-a41cfb5a9aee) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71f232f9-1a57-4e47-9802-04ce6806fc0b) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5f:58,bridge_name='br-int',has_traffic_filtering=True,id=5bcf9c47-838d-4b8a-b554-d7ce0f5325e7,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bcf9c47-83')
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:26 user nova-compute[75354]: WARNING nova.compute.manager [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state rebuild_spawning.
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:26 user nova-compute[75354]: WARNING nova.compute.manager [req-68fce7fc-3574-4055-9256-d8044456df9c req-dc2aa931-c0fb-4646-8544-c6b1175327ac service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state rebuild_spawning.
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2803bfd4-23, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: INFO os_vif [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:77:d2,bridge_name='br-int',has_traffic_filtering=True,id=6931719e-5eaf-4f1b-b88d-de1896c208fe,network=Network(dc4d1d74-b4d3-4d46-83c8-e48ee7326f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931719e-5e')
Nov 14 06:32:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Deleting instance files /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f_del
Nov 14 06:32:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Deletion of /opt/stack/data/nova/instances/1fc570b9-a592-425d-9c84-b67a7a37e07f_del complete
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: INFO nova.compute.manager [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Took 1.67 seconds to destroy the instance on the hypervisor.
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2bfb295-3f, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=313e6df9-1967-4dde-a575-4f5f2ebdb588) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 is timed out.
Nov 14 06:32:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully detached device vdb from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the live domain config.
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfzWNetj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:26 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4612c9-cd53-4780-9726-8b80e92c77e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:26 user nova-compute[75354]: No targets found.
Nov 14 06:32:26 user nova-compute[75354]: iSNS:
Nov 14 06:32:26 user nova-compute[75354]: No targets found.
Nov 14 06:32:26 user nova-compute[75354]: STATIC:
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:32:26 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:26 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:26 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:26 user nova-compute[75354]: No targets found.
Nov 14 06:32:26 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:26 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:26 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97fb02ca-d822-405f-b450-8db12e2015ca) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=2803bfd4-237d-4c4c-8bc1-ba3f06af623c,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2803bfd4-23')
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3edcf4b-118e-46e5-96e3-d9bcc9751592]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9379d-fe76-4194-b37d-0a4db7aeb022]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:26 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:26 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809434dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance spawned successfully.
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap716e270f-6b, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:1e,bridge_name='br-int',has_traffic_filtering=True,id=e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfb295-3f')
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32daf58-8138-414f-9ef2-403893f06394]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4715e950-d1f7-4dfb-9458-257ae4739f7b]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeeccaa-1cc8-4fa9-8083-eca44849bd4f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc3bee3c-71, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d3fb2c-102d-4835-a357-4afb40794e68]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=668756d2-df15-4a4a-ad78-c6825f1e6f1e) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6c3bc-bdc0-4ee5-b7ce-80a7b46a5923]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a139a109-bde7-4e63-bbd3-fa8b75ae67bd) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:da,bridge_name='br-int',has_traffic_filtering=True,id=716e270f-6bc1-4f8a-9968-8de88db5f1e3,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e270f-6b')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75354) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5d28a-b2b9-4e4e-9776-8d91973ca0cc]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260]
Nov 14 06:32:27 user nova-compute[75354]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:27 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394ecc71-adae-4484-bcda-389f47cdd38b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e682e67-495d-44c3-8bb5-63b4b25cb333]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35dddf93-07, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d1:bd,bridge_name='br-int',has_traffic_filtering=True,id=cc3bee3c-7140-4685-8efd-47ef0114816e,network=Network(4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3bee3c-71')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "1de9f506-7108-4957-a83c-5d123c23899f", "address": "fa:16:3e:d3:ed:03", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9f506-71", "ovs_interfaceid": "1de9f506-7108-4957-a83c-5d123c23899f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] <== disconnect_volume: return (413ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f519847a-4eff-4b5a-8515-37b59417441e tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.074s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1de9f506-71, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=837a3eec-b12e-4e79-a8e7-0f978224180f) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6f6d6a9-a432-4327-966b-49f9d875cdea) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:58:73,bridge_name='br-int',has_traffic_filtering=True,id=35dddf93-0717-4cdd-9e27-939b3b74c58d,network=Network(43db358b-2bab-4add-80a3-eb454244beb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dddf93-07')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e42539c-cf, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=1de9f506-7108-4957-a83c-5d123c23899f,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9f506-71')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1631443022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1631443022',id=10,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOVzHC/rGgO7z4v+RE0MjGQt+PGIgn9H3LHSvCqSD9oVxYOSxQm+CusgDYr3GSVWYTqg3Cduf595i2Ed2hZp7IkzdaFebkoqckB4Li3CbCvWtgeXSpBlr6zlZX0UD7ZQw==',key_name='tempest-keypair-849673605',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fedfa9b60822445facda789b60f344ec',ramdisk_id='',reservation_id='r-qd3yuktm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-181223013',owner_user_name='tempest-TaggedBootDevicesTest-181223013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a597d2cfd49f69d93bfd148972170',uuid=6379bb6f-54d6-4af9-bd98-f9d177676f33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converting VIF {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fab9a2e-96, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d7a78aa-7ee1-4d36-9f4f-37140a9f4f7b) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6760b569-1b0a-4c38-9d5d-d81f521af4ee) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:28:27,bridge_name='br-int',has_traffic_filtering=True,id=5e42539c-cf41-4a30-89f3-2d8444a45857,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e42539c-cf')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2132003956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2132003956',id=11,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9TjfRELLtqYVQOkFSHDL6bpDYplfzeazQU1eIjAAjMUBTipwsOsdmxrU/lGyux+iF37mUhvPtNRniRMkRSzi3qbIT/8KySEWrbPD5k+IO/ZfkKJl0ApFIG/LZD0MXeA==',key_name='tempest-keypair-1526579',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b8a5eefeb44585b15df33fce65ede3',ramdisk_id='',reservation_id='r-ohhg00z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1723211858',owner_user_name='tempest-TaggedBootDevicesTest_v242-1723211858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0852a8dbff1541579ba554b6ab0704af',uuid=0227dd34-937e-4079-a37d-ef3cbc39fcf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converting VIF {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96433f0d-9a, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:05:5b,bridge_name='br-int',has_traffic_filtering=True,id=3fab9a2e-9617-4db7-8a44-0a91d944cc4e,network=Network(bac30e31-528c-4e0e-ad83-986fbdb09e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fab9a2e-96')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOfvSGsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:27 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca979be3-25e0-4259-9a6b-e3dee0d3edc4) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: INFO os_vif [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:dd,bridge_name='br-int',has_traffic_filtering=True,id=96433f0d-9a51-4363-b14b-bc9a96836a2b,network=Network(e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96433f0d-9a')
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af367397-75ae-4ec2-be22-65942d8008ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:27 user nova-compute[75354]: No targets found.
Nov 14 06:32:27 user nova-compute[75354]: iSNS:
Nov 14 06:32:27 user nova-compute[75354]: No targets found.
Nov 14 06:32:27 user nova-compute[75354]: STATIC:
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf
Nov 14 06:32:27 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:27 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:27 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:27 user nova-compute[75354]: No targets found.
Nov 14 06:32:27 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:27 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:27 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjaFRSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:27 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd6173-fe5e-47a8-94d2-5ff648867340]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0487246-5a5c-4cab-8234-1bb1ba7fb9f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:27 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:27 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809426c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894f14b-741c-41c0-91a1-f344c69ecc32]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Took 1.08 seconds to deallocate network for instance.
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c6447-3f75-49c6-8336-439b193d7e11]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea1d31-211b-4eab-858a-4bdcd03c807d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f222aee-a9f6-4130-9f89-ff6b386027ba]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb069b7-d3ca-4972-b953-40524d6e2b43]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-f8f4d2fe-4300-4d30-9e0b-1cc6b2d20971 req-99364f38-a547-4502-a099-bac069e71d24 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f8f4d2fe-4300-4d30-9e0b-1cc6b2d20971 req-99364f38-a547-4502-a099-bac069e71d24 service nova] Acquiring lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f8f4d2fe-4300-4d30-9e0b-1cc6b2d20971 req-99364f38-a547-4502-a099-bac069e71d24 service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f8f4d2fe-4300-4d30-9e0b-1cc6b2d20971 req-99364f38-a547-4502-a099-bac069e71d24 service nova] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-f8f4d2fe-4300-4d30-9e0b-1cc6b2d20971 req-99364f38-a547-4502-a099-bac069e71d24 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] No waiting events found dispatching network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:27 user nova-compute[75354]: WARNING nova.compute.manager [req-f8f4d2fe-4300-4d30-9e0b-1cc6b2d20971 req-99364f38-a547-4502-a099-bac069e71d24 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received unexpected event network-vif-plugged-6931719e-5eaf-4f1b-b88d-de1896c208fe for instance with vm_state deleted and task_state None.
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7bf1a2-709f-4c4e-854e-7acc5c92c00c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260]
Nov 14 06:32:27 user nova-compute[75354]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:27 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4c8a5-53de-4e8a-9b0c-a8781f3efabf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05709251-7e92-44b0-8ff4-0e9cf5207bf5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.487s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== disconnect_volume: return (489ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.459s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cdtphrge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[691ad675-0f1a-4fcf-b1ae-f08aaa64b527]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:28 user nova-compute[75354]: No targets found.
Nov 14 06:32:28 user nova-compute[75354]: iSNS:
Nov 14 06:32:28 user nova-compute[75354]: No targets found.
Nov 14 06:32:28 user nova-compute[75354]: STATIC:
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:28 user nova-compute[75354]: No targets found.
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:28 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:28 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb52174-6819-4609-94c3-4cc210eeb6c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'flavor' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8e391a-4464-49e0-b8cc-342dc239b5a0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8094677250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095'): ({'sdg'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Removing single pathed devices sdg {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e72508-a4a3-4042-a0cd-40c6717db87a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a0850c-e858-4229-be3b-c9939992c51a]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Flushing IO for device /dev/sdg {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a5baff33-6dd2-4d7f-9702-f765353afee7 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.094s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b160d4-dd68-40a3-9f6a-d476e29373b3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f8ce8-15ad-47dd-843a-99e630901e2d]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] SCSI volumes sdg have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09f970-9932-43e3-a63a-555aaabae57c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.596s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Deleted allocations for instance 1fc570b9-a592-425d-9c84-b67a7a37e07f
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1becf00-ac16-47f3-9a90-fe26f86a32b5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260]
Nov 14 06:32:28 user nova-compute[75354]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-532ca560-51bc-4825-8a54-f849861423bc tempest-AttachSCSIVolumeTestJSON-1162113736 tempest-AttachSCSIVolumeTestJSON-1162113736-project-member] Lock "1fc570b9-a592-425d-9c84-b67a7a37e07f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.598s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a2afac9-1eb9-4181-91c2-c1b4a82e1095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f17a09-23eb-460e-8fb8-32a466252547]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.554s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== disconnect_volume: return (1014ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.552s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grSWHpyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8991c6b-265a-4749-9594-938580d47e26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-3612677e-b067-4550-a98b-f49ef8cef50e req-f794a91c-d483-4cbd-8c03-c710c382c538 service nova] [instance: 1fc570b9-a592-425d-9c84-b67a7a37e07f] Received event network-vif-deleted-6931719e-5eaf-4f1b-b88d-de1896c208fe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:28 user nova-compute[75354]: No targets found.
Nov 14 06:32:28 user nova-compute[75354]: iSNS:
Nov 14 06:32:28 user nova-compute[75354]: No targets found.
Nov 14 06:32:28 user nova-compute[75354]: STATIC:
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:28 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:28 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:28 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:28 user nova-compute[75354]: No targets found.
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:28 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:28 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[07330e91-37fa-4b16-a81a-fea27bd943c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced35b0b-1ff2-4ddf-b9c1-e76bd2b3abed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:28 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074457e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d'): ({'sdf'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Removing single pathed devices sdf {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b681811-f1e2-4d6a-8d24-fa1daa712a3b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e213b-243d-4bee-b79f-17dd8adfa5d3]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Flushing IO for device /dev/sdf {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a870dfd-b5e3-412a-8ace-4b5025916844]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17538693-1881-4ef1-9325-1008f6a926dc]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] SCSI volumes sdf have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79689af3-66ad-4f4e-be27-1cea437bb244]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "interface-6b2df786-b4e7-4593-b73b-4ee8d54f92e6-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "interface-6b2df786-b4e7-4593-b73b-4ee8d54f92e6-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'flavor' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fb96d2-fd9d-4736-8abc-b58c168e3256]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260]
Nov 14 06:32:28 user nova-compute[75354]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface> {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface> {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989e70ad-5b32-414c-8d79-1c3ce3e7e02d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4fc73f-7877-4141-b039-c97e034f230d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Attempting to detach device tapd191d6b3-6e from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] detach device xml: <interface type="ethernet">
Nov 14 06:32:29 user nova-compute[75354]:   <mac address="fa:16:3e:d8:8d:3a"/>
Nov 14 06:32:29 user nova-compute[75354]:   <model type="virtio"/>
Nov 14 06:32:29 user nova-compute[75354]:   <mtu size="1442"/>
Nov 14 06:32:29 user nova-compute[75354]:   <target dev="tapd191d6b3-6e"/>
Nov 14 06:32:29 user nova-compute[75354]: </interface>
Nov 14 06:32:29 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== disconnect_volume: return (1048ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.492s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPUlscxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:29 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface> {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 06:32:29 user nova-compute[75354]:   <name>instance-00000006</name>
Nov 14 06:32:29 user nova-compute[75354]:   <uuid>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</uuid>
Nov 14 06:32:29 user nova-compute[75354]:   <metadata>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:29 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:32:29 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:32:29 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:31:57</nova:creationTime>
Nov 14 06:32:29 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:32:29 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:29 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:32:29 user nova-compute[75354]:   <nova:owner>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:32:29 user nova-compute[75354]:   </nova:owner>
Nov 14 06:32:29 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:29 user nova-compute[75354]:   <nova:ports>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:32:29 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:32:29 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:29 user nova-compute[75354]:     <nova:port uuid="d191d6b3-6ebb-460f-8403-49eb5a9fc0ca">
Nov 14 06:32:29 user nova-compute[75354]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Nov 14 06:32:29 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:29 user nova-compute[75354]:   </nova:ports>
Nov 14 06:32:29 user nova-compute[75354]: </nova:instance>
Nov 14 06:32:29 user nova-compute[75354]:   </metadata>
Nov 14 06:32:29 user nova-compute[75354]:   <memory unit='KiB'>524288</memory>
Nov 14 06:32:29 user nova-compute[75354]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 06:32:29 user nova-compute[75354]:   <vcpu placement='static'>1</vcpu>
Nov 14 06:32:29 user nova-compute[75354]:   <resource>
Nov 14 06:32:29 user nova-compute[75354]:     <partition>/machine</partition>
Nov 14 06:32:29 user nova-compute[75354]:   </resource>
Nov 14 06:32:29 user nova-compute[75354]:   <sysinfo type='smbios'>
Nov 14 06:32:29 user nova-compute[75354]:     <system>
Nov 14 06:32:29 user nova-compute[75354]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 06:32:29 user nova-compute[75354]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 06:32:29 user nova-compute[75354]:       <entry name='version'>0.0.0</entry>
Nov 14 06:32:29 user nova-compute[75354]:       <entry name='serial'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:29 user nova-compute[75354]:       <entry name='uuid'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:29 user nova-compute[75354]:       <entry name='family'>Virtual Machine</entry>
Nov 14 06:32:29 user nova-compute[75354]:     </system>
Nov 14 06:32:29 user nova-compute[75354]:   </sysinfo>
Nov 14 06:32:29 user nova-compute[75354]:   <os>
Nov 14 06:32:29 user nova-compute[75354]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 06:32:29 user nova-compute[75354]:     <boot dev='hd'/>
Nov 14 06:32:29 user nova-compute[75354]:     <smbios mode='sysinfo'/>
Nov 14 06:32:29 user nova-compute[75354]:   </os>
Nov 14 06:32:29 user nova-compute[75354]:   <features>
Nov 14 06:32:29 user nova-compute[75354]:     <acpi/>
Nov 14 06:32:29 user nova-compute[75354]:     <apic/>
Nov 14 06:32:29 user nova-compute[75354]:     <vmcoreinfo state='on'/>
Nov 14 06:32:29 user nova-compute[75354]:   </features>
Nov 14 06:32:29 user nova-compute[75354]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 06:32:29 user nova-compute[75354]:     <model fallback='forbid'>Nehalem</model>
Nov 14 06:32:29 user nova-compute[75354]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 06:32:29 user nova-compute[75354]:     <feature policy='require' name='vme'/>
Nov 14 06:32:29 user nova-compute[75354]:     <feature policy='require' name='x2apic'/>
Nov 14 06:32:29 user nova-compute[75354]:     <feature policy='require' name='hypervisor'/>
Nov 14 06:32:29 user nova-compute[75354]:   </cpu>
Nov 14 06:32:29 user nova-compute[75354]:   <clock offset='utc'>
Nov 14 06:32:29 user nova-compute[75354]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 06:32:29 user nova-compute[75354]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 06:32:29 user nova-compute[75354]:     <timer name='hpet' present='no'/>
Nov 14 06:32:29 user nova-compute[75354]:   </clock>
Nov 14 06:32:29 user nova-compute[75354]:   <on_poweroff>destroy</on_poweroff>
Nov 14 06:32:29 user nova-compute[75354]:   <on_reboot>restart</on_reboot>
Nov 14 06:32:29 user nova-compute[75354]:   <on_crash>destroy</on_crash>
Nov 14 06:32:29 user nova-compute[75354]:   <devices>
Nov 14 06:32:29 user nova-compute[75354]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 06:32:29 user nova-compute[75354]:     <disk type='file' device='disk'>
Nov 14 06:32:29 user nova-compute[75354]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 06:32:29 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk' index='2'/>
Nov 14 06:32:29 user nova-compute[75354]:       <backingStore type='file' index='3'>
Nov 14 06:32:29 user nova-compute[75354]:         <format type='raw'/>
Nov 14 06:32:29 user nova-compute[75354]:         <source file='/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10'/>
Nov 14 06:32:29 user nova-compute[75354]:         <backingStore/>
Nov 14 06:32:29 user nova-compute[75354]:       </backingStore>
Nov 14 06:32:29 user nova-compute[75354]:       <target dev='vda' bus='virtio'/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='virtio-disk0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </disk>
Nov 14 06:32:29 user nova-compute[75354]:     <disk type='file' device='cdrom'>
Nov 14 06:32:29 user nova-compute[75354]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 06:32:29 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config' index='1'/>
Nov 14 06:32:29 user nova-compute[75354]:       <backingStore/>
Nov 14 06:32:29 user nova-compute[75354]:       <target dev='hda' bus='ide'/>
Nov 14 06:32:29 user nova-compute[75354]:       <readonly/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='ide0-0-0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </disk>
Nov 14 06:32:29 user nova-compute[75354]:     <controller type='usb' index='0' model='none'>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='usb'/>
Nov 14 06:32:29 user nova-compute[75354]:     </controller>
Nov 14 06:32:29 user nova-compute[75354]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='pci.0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </controller>
Nov 14 06:32:29 user nova-compute[75354]:     <controller type='ide' index='0'>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='ide'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 06:32:29 user nova-compute[75354]:     </controller>
Nov 14 06:32:29 user nova-compute[75354]:     <interface type='ethernet'>
Nov 14 06:32:29 user nova-compute[75354]:       <mac address='fa:16:3e:43:a3:7d'/>
Nov 14 06:32:29 user nova-compute[75354]:       <target dev='tap11e84908-33'/>
Nov 14 06:32:29 user nova-compute[75354]:       <model type='virtio'/>
Nov 14 06:32:29 user nova-compute[75354]:       <mtu size='1442'/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='net0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </interface>
Nov 14 06:32:29 user nova-compute[75354]:     <interface type='ethernet'>
Nov 14 06:32:29 user nova-compute[75354]:       <mac address='fa:16:3e:d8:8d:3a'/>
Nov 14 06:32:29 user nova-compute[75354]:       <target dev='tapd191d6b3-6e'/>
Nov 14 06:32:29 user nova-compute[75354]:       <model type='virtio'/>
Nov 14 06:32:29 user nova-compute[75354]:       <mtu size='1442'/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='net1'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </interface>
Nov 14 06:32:29 user nova-compute[75354]:     <serial type='pty'>
Nov 14 06:32:29 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:29 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:29 user nova-compute[75354]:       <target type='isa-serial' port='0'>
Nov 14 06:32:29 user nova-compute[75354]:         <model name='isa-serial'/>
Nov 14 06:32:29 user nova-compute[75354]:       </target>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </serial>
Nov 14 06:32:29 user nova-compute[75354]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 06:32:29 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:29 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:29 user nova-compute[75354]:       <target type='serial' port='0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </console>
Nov 14 06:32:29 user nova-compute[75354]:     <input type='mouse' bus='ps2'>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='input0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </input>
Nov 14 06:32:29 user nova-compute[75354]:     <input type='keyboard' bus='ps2'>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='input1'/>
Nov 14 06:32:29 user nova-compute[75354]:     </input>
Nov 14 06:32:29 user nova-compute[75354]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 06:32:29 user nova-compute[75354]:       <listen type='address' address='0.0.0.0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </graphics>
Nov 14 06:32:29 user nova-compute[75354]:     <audio id='1' type='none'/>
Nov 14 06:32:29 user nova-compute[75354]:     <video>
Nov 14 06:32:29 user nova-compute[75354]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='video0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </video>
Nov 14 06:32:29 user nova-compute[75354]:     <memballoon model='virtio'>
Nov 14 06:32:29 user nova-compute[75354]:       <stats period='10'/>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='balloon0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </memballoon>
Nov 14 06:32:29 user nova-compute[75354]:     <rng model='virtio'>
Nov 14 06:32:29 user nova-compute[75354]:       <backend model='random'>/dev/urandom</backend>
Nov 14 06:32:29 user nova-compute[75354]:       <alias name='rng0'/>
Nov 14 06:32:29 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 06:32:29 user nova-compute[75354]:     </rng>
Nov 14 06:32:29 user nova-compute[75354]:   </devices>
Nov 14 06:32:29 user nova-compute[75354]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 06:32:29 user nova-compute[75354]:     <label>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</label>
Nov 14 06:32:29 user nova-compute[75354]:     <imagelabel>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</imagelabel>
Nov 14 06:32:29 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:29 user nova-compute[75354]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 06:32:29 user nova-compute[75354]:     <label>+64055:+108</label>
Nov 14 06:32:29 user nova-compute[75354]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 06:32:29 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:29 user nova-compute[75354]: </domain>
Nov 14 06:32:29 user nova-compute[75354]:  {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 06:32:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully detached device tapd191d6b3-6e from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the persistent domain config.
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] (1/8): Attempting to detach device tapd191d6b3-6e with device alias net1 from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] detach device xml: <interface type="ethernet">
Nov 14 06:32:29 user nova-compute[75354]:   <mac address="fa:16:3e:d8:8d:3a"/>
Nov 14 06:32:29 user nova-compute[75354]:   <model type="virtio"/>
Nov 14 06:32:29 user nova-compute[75354]:   <mtu size="1442"/>
Nov 14 06:32:29 user nova-compute[75354]:   <target dev="tapd191d6b3-6e"/>
Nov 14 06:32:29 user nova-compute[75354]: </interface>
Nov 14 06:32:29 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff9f10c-f7db-42aa-a6dd-bca094ea0b67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]: iSNS:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]: STATIC:
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:29 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:29 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d27325-3678-4a2f-b0a8-d212dbeebf23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf81a01d-1f1b-4323-babd-ab93400f7713]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743dd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bb1883-aab0-4a48-b659-fc30087593c0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d409098-c207-44aa-9229-2ecc5109cf73]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[510dfa0e-df63-4d00-aca5-b570d9fcdd0e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd92bfd5-54f8-4df5-a4f9-8ac95abb03ce]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f856789-6904-436a-9e1d-451161743b97]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Start waiting for the detach event from libvirt for device tapd191d6b3-6e with device alias net1 for instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd8357-2cc8-4c09-bcf8-252bb55729f3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260]
Nov 14 06:32:29 user nova-compute[75354]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be69d8e4-d44d-4fd9-b8a2-03c8b1697679 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de33d4fc-9927-48f1-b417-c4113125b571]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== disconnect_volume: return (913ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.419s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEhaWFeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:29 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[085cc31e-148a-49de-b439-c594567dd16c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]: iSNS:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]: STATIC:
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:29 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:29 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[18316ffc-bc3f-4af5-bf4b-cce28ed9a285]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-689173af-0f21-42a7-956b-f21829a3a556 req-2ad5eb21-2ab3-4f3c-8e0a-48bcef5433d8 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-unplugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-689173af-0f21-42a7-956b-f21829a3a556 req-2ad5eb21-2ab3-4f3c-8e0a-48bcef5433d8 service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-689173af-0f21-42a7-956b-f21829a3a556 req-2ad5eb21-2ab3-4f3c-8e0a-48bcef5433d8 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-689173af-0f21-42a7-956b-f21829a3a556 req-2ad5eb21-2ab3-4f3c-8e0a-48bcef5433d8 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-689173af-0f21-42a7-956b-f21829a3a556 req-2ad5eb21-2ab3-4f3c-8e0a-48bcef5433d8 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-unplugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:29 user nova-compute[75354]: WARNING nova.compute.manager [req-689173af-0f21-42a7-956b-f21829a3a556 req-2ad5eb21-2ab3-4f3c-8e0a-48bcef5433d8 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-unplugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca for instance with vm_state active and task_state None.
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54792b-f29a-4f5b-a486-2b519b827b42]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:29 user nova-compute[75354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b (non-flash)
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743dd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b'): ({'sdh'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Removing single pathed devices sdh {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fedb6f3-d45d-489e-b4d3-d8c20cecca30]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0687b549-d033-4fd9-bb85-c2f5e90c57d3]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Flushing IO for device /dev/sdh {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e479f897-8805-42e0-a87a-bfff78f02244]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10dcfd-4f5c-46e5-aef3-bbbec3f42ebb]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] SCSI volumes sdh have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30ac631-6389-4ef8-82bd-f219b874dedd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817f75a-f2b1-4df3-b29e-61d413a5c3ef]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260]
Nov 14 06:32:29 user nova-compute[75354]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de19194-d8f7-4032-a257-11bd510c260b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa7d0a-d71a-4564-a6d0-ea8da4832b5f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] <== disconnect_volume: return (841ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Deleting instance files /opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33_del
Nov 14 06:32:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Deletion of /opt/stack/data/nova/instances/6379bb6f-54d6-4af9-bd98-f9d177676f33_del complete
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.427s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[137e52d8-28e7-49cc-a23d-571d034b56cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]: iSNS:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]: STATIC:
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:29 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:29 user nova-compute[75354]: No targets found.
Nov 14 06:32:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:30 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:30 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b66740-464b-45c5-8931-92db376aee4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0d5ed6-e46a-47d4-92c2-2f7d387b01cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074475870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: INFO nova.compute.manager [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Took 9.20 seconds to destroy the instance on the hypervisor.
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0cc5f-af4e-4259-b8dd-78758cafe0a5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff98d099-24ff-47d2-9b33-1cc14ef32116]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d57c0b1-9647-4169-b422-419c5f305338]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bf00e5-eccd-41a5-87b9-932feeabc633]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ff8aeb-5a14-44e0-a38a-8469199e441c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:32:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8113MB free_disk=25.664512634277344GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ded90c9-70cd-45f2-b81c-935391520c98]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260]
Nov 14 06:32:30 user nova-compute[75354]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d80834-4801-4916-aba6-5c176a359785 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6a0de4-2c33-4392-98b4-955180590648]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.792s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] <== disconnect_volume: return (1220ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Deleting instance files /opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7_del
Nov 14 06:32:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Deletion of /opt/stack/data/nova/instances/0227dd34-937e-4079-a37d-ef3cbc39fcf7_del complete
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b96beb17-09e1-45a2-8699-8657baa034e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 93429017-a737-45d4-965b-d7369a440bf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9677bd15-7e09-41db-8f75-0da15ac5d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6379bb6f-54d6-4af9-bd98-f9d177676f33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:32:30 user nova-compute[75354]: INFO nova.compute.manager [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Took 8.77 seconds to destroy the instance on the hypervisor.
Nov 14 06:32:30 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:32:30 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-c4332597-8195-4990-932e-15c84376aec4 req-5bd92e66-0fc8-438b-89e2-af14b90a03c4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c4332597-8195-4990-932e-15c84376aec4 req-5bd92e66-0fc8-438b-89e2-af14b90a03c4 service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c4332597-8195-4990-932e-15c84376aec4 req-5bd92e66-0fc8-438b-89e2-af14b90a03c4 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c4332597-8195-4990-932e-15c84376aec4 req-5bd92e66-0fc8-438b-89e2-af14b90a03c4 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-c4332597-8195-4990-932e-15c84376aec4 req-5bd92e66-0fc8-438b-89e2-af14b90a03c4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:31 user nova-compute[75354]: WARNING nova.compute.manager [req-c4332597-8195-4990-932e-15c84376aec4 req-5bd92e66-0fc8-438b-89e2-af14b90a03c4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-plugged-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca for instance with vm_state active and task_state None.
Nov 14 06:32:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-373ab380-8af0-49f6-941b-0f5f0876f0c2 req-c35d6cab-954d-4e35-8149-d2c3f6425f92 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-deleted-1de9f506-7108-4957-a83c-5d123c23899f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:33 user nova-compute[75354]: INFO nova.compute.manager [req-373ab380-8af0-49f6-941b-0f5f0876f0c2 req-c35d6cab-954d-4e35-8149-d2c3f6425f92 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Neutron deleted interface 1de9f506-7108-4957-a83c-5d123c23899f; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-373ab380-8af0-49f6-941b-0f5f0876f0c2 req-c35d6cab-954d-4e35-8149-d2c3f6425f92 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [{"id": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "address": "fa:16:3e:9b:6b:62", "network": {"id": "037e8bb0-f3ed-4dda-bb00-99eeb3137264", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1988513490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910b8cb8-aa", "ovs_interfaceid": "910b8cb8-aaf7-4582-9d9d-47d08025d4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-373ab380-8af0-49f6-941b-0f5f0876f0c2 req-c35d6cab-954d-4e35-8149-d2c3f6425f92 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Detach interface failed, port_id=1de9f506-7108-4957-a83c-5d123c23899f, reason: Instance 6379bb6f-54d6-4af9-bd98-f9d177676f33 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-deleted-910b8cb8-aaf7-4582-9d9d-47d08025d4d8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:35 user nova-compute[75354]: INFO nova.compute.manager [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Neutron deleted interface 910b8cb8-aaf7-4582-9d9d-47d08025d4d8; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [{"id": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "address": "fa:16:3e:07:62:3b", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc28cce-fb", "ovs_interfaceid": "2dc28cce-fb57-4770-bda6-3ab935236bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "address": "fa:16:3e:73:5f:58", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bcf9c47-83", "ovs_interfaceid": "5bcf9c47-838d-4b8a-b554-d7ce0f5325e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "address": "fa:16:3e:b6:86:1e", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfb295-3f", "ovs_interfaceid": "e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc3bee3c-7140-4685-8efd-47ef0114816e", "address": "fa:16:3e:b8:d1:bd", "network": {"id": "4f2f6529-75d7-4ffd-b6c3-22f1094fcbf4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296259104", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3bee3c-71", "ovs_interfaceid": "cc3bee3c-7140-4685-8efd-47ef0114816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "address": "fa:16:3e:b8:05:5b", "network": {"id": "bac30e31-528c-4e0e-ad83-986fbdb09e46", "bridge": "br-int", "label": "tempest-device-tagging-net2-41969702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fedfa9b60822445facda789b60f344ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fab9a2e-96", "ovs_interfaceid": "3fab9a2e-9617-4db7-8a44-0a91d944cc4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Detach interface failed, port_id=910b8cb8-aaf7-4582-9d9d-47d08025d4d8, reason: Instance 6379bb6f-54d6-4af9-bd98-f9d177676f33 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-deleted-75a319db-14c0-4114-9c6e-d818fafe8e84 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:35 user nova-compute[75354]: INFO nova.compute.manager [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Neutron deleted interface 75a319db-14c0-4114-9c6e-d818fafe8e84; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "address": "fa:16:3e:86:01:da", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e270f-6b", "ovs_interfaceid": "716e270f-6bc1-4f8a-9968-8de88db5f1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-c9c3bf0c-6c9e-46f8-8344-06db86574390 req-4b5b1cd3-0df0-447a-ba11-ca5419729273 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Detach interface failed, port_id=75a319db-14c0-4114-9c6e-d818fafe8e84, reason: Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updating instance_info_cache with network_info: [{"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:35 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9677bd15-7e09-41db-8f75-0da15ac5d426 is timed out.
Nov 14 06:32:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Successfully detached device vdb from instance 9677bd15-7e09-41db-8f75-0da15ac5d426 from the live domain config.
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUbHNTqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:35 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-b96beb17-09e1-45a2-8699-8657baa034e8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58280d73-6923-4baa-96c7-db32b665b9c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:35 user nova-compute[75354]: No targets found.
Nov 14 06:32:35 user nova-compute[75354]: iSNS:
Nov 14 06:32:35 user nova-compute[75354]: No targets found.
Nov 14 06:32:35 user nova-compute[75354]: STATIC:
Nov 14 06:32:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d
Nov 14 06:32:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:35 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:35 user nova-compute[75354]: No targets found.
Nov 14 06:32:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:35 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:35 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b31fe-db54-4428-b3d8-232a0b570179]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff6800-1a8b-4651-948a-bb75382b4640]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:35 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:35 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:35 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:35 user nova-compute[75354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d (non-flash)
Nov 14 06:32:35 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:35 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743de680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d'): ({'sdm'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Removing single pathed devices sdm {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64762f4-f1be-46e9-9674-ff2c2874fc03]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100906b-8600-43b4-8c40-2290c3409a9a]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Flushing IO for device /dev/sdm {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb604f4a-0362-4532-aa2d-e45c231bc4f5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.044s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c46d4-5c3d-4650-8928-f81e3fb28d55]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] SCSI volumes sdm have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2624358e-08ba-433c-9774-b075a0897e0c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c1b2c-5731-4410-90da-6e6987e8fa2f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260]
Nov 14 06:32:36 user nova-compute[75354]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e251dac-643d-4d5f-a1b7-a1c5a606608d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acbcf5b-b7c6-4774-9b28-0767bc8601ff]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] <== disconnect_volume: return (344ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:36 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:36 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Took 6.80 seconds to deallocate network for instance.
Nov 14 06:32:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lazy-loading 'flavor' on Instance uuid 9677bd15-7e09-41db-8f75-0da15ac5d426 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-be469c59-de6f-4244-9df8-c11d5acd1828 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-deleted-e2bfb295-3fb2-4f04-81f4-84d7e7c4ef5f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-deleted-716e270f-6bc1-4f8a-9968-8de88db5f1e3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:37 user nova-compute[75354]: INFO nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Neutron deleted interface 716e270f-6bc1-4f8a-9968-8de88db5f1e3; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "address": "fa:16:3e:e4:8c:dd", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96433f0d-9a", "ovs_interfaceid": "96433f0d-9a51-4363-b14b-bc9a96836a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Detach interface failed, port_id=716e270f-6bc1-4f8a-9968-8de88db5f1e3, reason: Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-deleted-96433f0d-9a51-4363-b14b-bc9a96836a2b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:37 user nova-compute[75354]: INFO nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Neutron deleted interface 96433f0d-9a51-4363-b14b-bc9a96836a2b; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "address": "fa:16:3e:84:58:73", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dddf93-07", "ovs_interfaceid": "35dddf93-0717-4cdd-9e27-939b3b74c58d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Detach interface failed, port_id=96433f0d-9a51-4363-b14b-bc9a96836a2b, reason: Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-deleted-3fab9a2e-9617-4db7-8a44-0a91d944cc4e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-deleted-35dddf93-0717-4cdd-9e27-939b3b74c58d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:37 user nova-compute[75354]: INFO nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Neutron deleted interface 35dddf93-0717-4cdd-9e27-939b3b74c58d; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e42539c-cf41-4a30-89f3-2d8444a45857", "address": "fa:16:3e:e1:28:27", "network": {"id": "e1d54f4b-a8d4-41f4-a4cf-6568cac3f7b6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2102470895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e42539c-cf", "ovs_interfaceid": "5e42539c-cf41-4a30-89f3-2d8444a45857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:37 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Took 6.52 seconds to deallocate network for instance.
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Detach interface failed, port_id=35dddf93-0717-4cdd-9e27-939b3b74c58d, reason: Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-038b8a79-14f3-4ecc-a4e8-b9a9d835944b req-c255eb6c-96f6-455b-af59-06eb3d40cec0 service nova] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Received event network-vif-deleted-cc3bee3c-7140-4685-8efd-47ef0114816e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:39 user nova-compute[75354]: INFO nova.compute.manager [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] [instance: 6379bb6f-54d6-4af9-bd98-f9d177676f33] Took 2.28 seconds to detach 3 volumes for instance.
Nov 14 06:32:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-8d24336a-f904-45dd-b87e-7b897a7e2d48 req-0548d0dc-acc7-487c-bd37-8af0e6019851 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Received event network-vif-deleted-5e42539c-cf41-4a30-89f3-2d8444a45857 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:39 user nova-compute[75354]: INFO nova.compute.manager [req-8d24336a-f904-45dd-b87e-7b897a7e2d48 req-0548d0dc-acc7-487c-bd37-8af0e6019851 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Neutron deleted interface 5e42539c-cf41-4a30-89f3-2d8444a45857; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:39 user nova-compute[75354]: DEBUG nova.network.neutron [req-8d24336a-f904-45dd-b87e-7b897a7e2d48 req-0548d0dc-acc7-487c-bd37-8af0e6019851 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Updating instance_info_cache with network_info: [{"id": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "address": "fa:16:3e:e6:35:c4", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51db9d6-23", "ovs_interfaceid": "c51db9d6-2363-4b49-a6ce-4f823ef56e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "address": "fa:16:3e:94:01:a9", "network": {"id": "43db358b-2bab-4add-80a3-eb454244beb5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2137567128", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24b8a5eefeb44585b15df33fce65ede3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803bfd4-23", "ovs_interfaceid": "2803bfd4-237d-4c4c-8bc1-ba3f06af623c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-8d24336a-f904-45dd-b87e-7b897a7e2d48 req-0548d0dc-acc7-487c-bd37-8af0e6019851 service nova] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Detach interface failed, port_id=5e42539c-cf41-4a30-89f3-2d8444a45857, reason: Instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:39 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Deleted allocations for instance 6379bb6f-54d6-4af9-bd98-f9d177676f33
Nov 14 06:32:39 user nova-compute[75354]: INFO nova.compute.manager [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] [instance: 0227dd34-937e-4079-a37d-ef3cbc39fcf7] Took 2.32 seconds to detach 3 volumes for instance.
Nov 14 06:32:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fe9953e-57ce-4e54-8414-8f94dfe2b7bb tempest-TaggedBootDevicesTest-181223013 tempest-TaggedBootDevicesTest-181223013-project-member] Lock "6379bb6f-54d6-4af9-bd98-f9d177676f33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.846s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:40 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 is timed out.
Nov 14 06:32:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Successfully detached device vdb from instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 from the live domain config.
Nov 14 06:32:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNosmdAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:32:40 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95edc2c-d78e-45c2-95e5-bea98d1cc2f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:32:40 user nova-compute[75354]: No targets found.
Nov 14 06:32:40 user nova-compute[75354]: iSNS:
Nov 14 06:32:40 user nova-compute[75354]: No targets found.
Nov 14 06:32:40 user nova-compute[75354]: STATIC:
Nov 14 06:32:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:32:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3
Nov 14 06:32:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:40 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:32:40 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:32:40 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:32:40 user nova-compute[75354]: FIRMWARE:
Nov 14 06:32:40 user nova-compute[75354]: No targets found.
Nov 14 06:32:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:32:40 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:32:40 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f24abc-ca4d-4d02-bf08-29590040beec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ea99c8-c4f7-4bde-98ec-237cc2199d3b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:40 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:40 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:32:40 user nova-compute[75354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 (non-flash)
Nov 14 06:32:40 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:32:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074467ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3'): ({'sdl'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Removing single pathed devices sdl {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ba0cf-e227-4cea-acdc-8f7e9ef32cde]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de34017-5e9b-47da-9b25-191d41570df6]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Flushing IO for device /dev/sdl {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a73983-75eb-4471-90f2-7f98f3c35e06]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.118s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded02ac-715d-4977-95ef-414f80767c0a]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] SCSI volumes sdl have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.648s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53815a6d-cd84-4f2c-98c8-40793bcbf770]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Deleted allocations for instance 0227dd34-937e-4079-a37d-ef3cbc39fcf7
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[082cf85c-0304-4975-b2f9-850250509c7b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260]
Nov 14 06:32:40 user nova-compute[75354]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3, portal: 172.16.0.220,3260] successful.
Nov 14 06:32:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d8aaf4-5d1d-4e3f-bc25-17cba34c25c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6e1864-d6ac-4671-9be6-df3aed90205e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] <== disconnect_volume: return (421ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:32:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-23983d89-ef3f-4828-8b4e-e3d9a89818c2 tempest-TaggedBootDevicesTest_v242-1723211858 tempest-TaggedBootDevicesTest_v242-1723211858-project-member] Lock "0227dd34-937e-4079-a37d-ef3cbc39fcf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.477s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lazy-loading 'flavor' on Instance uuid 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca60228-da9a-4180-8bb7-561ae9aa6a69 tempest-VolumesAssistedSnapshotsTest-796884103 tempest-VolumesAssistedSnapshotsTest-796884103-project-admin] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.382s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:49 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Waiting for libvirt event about the detach of device tapd191d6b3-6e with device alias net1 from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 is timed out.
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface> {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 06:32:49 user nova-compute[75354]:   <name>instance-00000006</name>
Nov 14 06:32:49 user nova-compute[75354]:   <uuid>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</uuid>
Nov 14 06:32:49 user nova-compute[75354]:   <metadata>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:49 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:31:57</nova:creationTime>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:32:49 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:49 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:owner>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:32:49 user nova-compute[75354]:   </nova:owner>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:ports>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:32:49 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:32:49 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:port uuid="d191d6b3-6ebb-460f-8403-49eb5a9fc0ca">
Nov 14 06:32:49 user nova-compute[75354]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Nov 14 06:32:49 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:49 user nova-compute[75354]:   </nova:ports>
Nov 14 06:32:49 user nova-compute[75354]: </nova:instance>
Nov 14 06:32:49 user nova-compute[75354]:   </metadata>
Nov 14 06:32:49 user nova-compute[75354]:   <memory unit='KiB'>524288</memory>
Nov 14 06:32:49 user nova-compute[75354]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 06:32:49 user nova-compute[75354]:   <vcpu placement='static'>1</vcpu>
Nov 14 06:32:49 user nova-compute[75354]:   <resource>
Nov 14 06:32:49 user nova-compute[75354]:     <partition>/machine</partition>
Nov 14 06:32:49 user nova-compute[75354]:   </resource>
Nov 14 06:32:49 user nova-compute[75354]:   <sysinfo type='smbios'>
Nov 14 06:32:49 user nova-compute[75354]:     <system>
Nov 14 06:32:49 user nova-compute[75354]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 06:32:49 user nova-compute[75354]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 06:32:49 user nova-compute[75354]:       <entry name='version'>0.0.0</entry>
Nov 14 06:32:49 user nova-compute[75354]:       <entry name='serial'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:49 user nova-compute[75354]:       <entry name='uuid'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:49 user nova-compute[75354]:       <entry name='family'>Virtual Machine</entry>
Nov 14 06:32:49 user nova-compute[75354]:     </system>
Nov 14 06:32:49 user nova-compute[75354]:   </sysinfo>
Nov 14 06:32:49 user nova-compute[75354]:   <os>
Nov 14 06:32:49 user nova-compute[75354]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 06:32:49 user nova-compute[75354]:     <boot dev='hd'/>
Nov 14 06:32:49 user nova-compute[75354]:     <smbios mode='sysinfo'/>
Nov 14 06:32:49 user nova-compute[75354]:   </os>
Nov 14 06:32:49 user nova-compute[75354]:   <features>
Nov 14 06:32:49 user nova-compute[75354]:     <acpi/>
Nov 14 06:32:49 user nova-compute[75354]:     <apic/>
Nov 14 06:32:49 user nova-compute[75354]:     <vmcoreinfo state='on'/>
Nov 14 06:32:49 user nova-compute[75354]:   </features>
Nov 14 06:32:49 user nova-compute[75354]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 06:32:49 user nova-compute[75354]:     <model fallback='forbid'>Nehalem</model>
Nov 14 06:32:49 user nova-compute[75354]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 06:32:49 user nova-compute[75354]:     <feature policy='require' name='vme'/>
Nov 14 06:32:49 user nova-compute[75354]:     <feature policy='require' name='x2apic'/>
Nov 14 06:32:49 user nova-compute[75354]:     <feature policy='require' name='hypervisor'/>
Nov 14 06:32:49 user nova-compute[75354]:   </cpu>
Nov 14 06:32:49 user nova-compute[75354]:   <clock offset='utc'>
Nov 14 06:32:49 user nova-compute[75354]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 06:32:49 user nova-compute[75354]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 06:32:49 user nova-compute[75354]:     <timer name='hpet' present='no'/>
Nov 14 06:32:49 user nova-compute[75354]:   </clock>
Nov 14 06:32:49 user nova-compute[75354]:   <on_poweroff>destroy</on_poweroff>
Nov 14 06:32:49 user nova-compute[75354]:   <on_reboot>restart</on_reboot>
Nov 14 06:32:49 user nova-compute[75354]:   <on_crash>destroy</on_crash>
Nov 14 06:32:49 user nova-compute[75354]:   <devices>
Nov 14 06:32:49 user nova-compute[75354]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 06:32:49 user nova-compute[75354]:     <disk type='file' device='disk'>
Nov 14 06:32:49 user nova-compute[75354]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 06:32:49 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk' index='2'/>
Nov 14 06:32:49 user nova-compute[75354]:       <backingStore type='file' index='3'>
Nov 14 06:32:49 user nova-compute[75354]:         <format type='raw'/>
Nov 14 06:32:49 user nova-compute[75354]:         <source file='/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10'/>
Nov 14 06:32:49 user nova-compute[75354]:         <backingStore/>
Nov 14 06:32:49 user nova-compute[75354]:       </backingStore>
Nov 14 06:32:49 user nova-compute[75354]:       <target dev='vda' bus='virtio'/>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='virtio-disk0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </disk>
Nov 14 06:32:49 user nova-compute[75354]:     <disk type='file' device='cdrom'>
Nov 14 06:32:49 user nova-compute[75354]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 06:32:49 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config' index='1'/>
Nov 14 06:32:49 user nova-compute[75354]:       <backingStore/>
Nov 14 06:32:49 user nova-compute[75354]:       <target dev='hda' bus='ide'/>
Nov 14 06:32:49 user nova-compute[75354]:       <readonly/>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='ide0-0-0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </disk>
Nov 14 06:32:49 user nova-compute[75354]:     <controller type='usb' index='0' model='none'>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='usb'/>
Nov 14 06:32:49 user nova-compute[75354]:     </controller>
Nov 14 06:32:49 user nova-compute[75354]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='pci.0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </controller>
Nov 14 06:32:49 user nova-compute[75354]:     <controller type='ide' index='0'>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='ide'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 06:32:49 user nova-compute[75354]:     </controller>
Nov 14 06:32:49 user nova-compute[75354]:     <interface type='ethernet'>
Nov 14 06:32:49 user nova-compute[75354]:       <mac address='fa:16:3e:43:a3:7d'/>
Nov 14 06:32:49 user nova-compute[75354]:       <target dev='tap11e84908-33'/>
Nov 14 06:32:49 user nova-compute[75354]:       <model type='virtio'/>
Nov 14 06:32:49 user nova-compute[75354]:       <mtu size='1442'/>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='net0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </interface>
Nov 14 06:32:49 user nova-compute[75354]:     <serial type='pty'>
Nov 14 06:32:49 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:49 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:49 user nova-compute[75354]:       <target type='isa-serial' port='0'>
Nov 14 06:32:49 user nova-compute[75354]:         <model name='isa-serial'/>
Nov 14 06:32:49 user nova-compute[75354]:       </target>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </serial>
Nov 14 06:32:49 user nova-compute[75354]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 06:32:49 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:49 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:49 user nova-compute[75354]:       <target type='serial' port='0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </console>
Nov 14 06:32:49 user nova-compute[75354]:     <input type='mouse' bus='ps2'>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='input0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </input>
Nov 14 06:32:49 user nova-compute[75354]:     <input type='keyboard' bus='ps2'>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='input1'/>
Nov 14 06:32:49 user nova-compute[75354]:     </input>
Nov 14 06:32:49 user nova-compute[75354]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 06:32:49 user nova-compute[75354]:       <listen type='address' address='0.0.0.0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </graphics>
Nov 14 06:32:49 user nova-compute[75354]:     <audio id='1' type='none'/>
Nov 14 06:32:49 user nova-compute[75354]:     <video>
Nov 14 06:32:49 user nova-compute[75354]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='video0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </video>
Nov 14 06:32:49 user nova-compute[75354]:     <memballoon model='virtio'>
Nov 14 06:32:49 user nova-compute[75354]:       <stats period='10'/>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='balloon0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </memballoon>
Nov 14 06:32:49 user nova-compute[75354]:     <rng model='virtio'>
Nov 14 06:32:49 user nova-compute[75354]:       <backend model='random'>/dev/urandom</backend>
Nov 14 06:32:49 user nova-compute[75354]:       <alias name='rng0'/>
Nov 14 06:32:49 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 06:32:49 user nova-compute[75354]:     </rng>
Nov 14 06:32:49 user nova-compute[75354]:   </devices>
Nov 14 06:32:49 user nova-compute[75354]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 06:32:49 user nova-compute[75354]:     <label>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</label>
Nov 14 06:32:49 user nova-compute[75354]:     <imagelabel>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</imagelabel>
Nov 14 06:32:49 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:49 user nova-compute[75354]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 06:32:49 user nova-compute[75354]:     <label>+64055:+108</label>
Nov 14 06:32:49 user nova-compute[75354]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 06:32:49 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:49 user nova-compute[75354]: </domain>
Nov 14 06:32:49 user nova-compute[75354]:  {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 06:32:49 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully detached device tapd191d6b3-6e from instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 from the live domain config.
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG os_vif [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd191d6b3-6e, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d165fd1e-e148-40af-a11f-9b7d10f1c6da) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:49 user nova-compute[75354]: INFO os_vif [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e')
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:49 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:32:49</nova:creationTime>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:32:49 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:49 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:owner>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:32:49 user nova-compute[75354]:   </nova:owner>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:49 user nova-compute[75354]:   <nova:ports>
Nov 14 06:32:49 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:32:49 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:32:49 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:49 user nova-compute[75354]:   </nova:ports>
Nov 14 06:32:49 user nova-compute[75354]: </nova:instance>
Nov 14 06:32:49 user nova-compute[75354]:  {{(pid=75354) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "afb399e4-fd36-455d-b7c7-ac160f32ce79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:32:49 user nova-compute[75354]: INFO nova.compute.claims [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Claim successful on node user
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-deleted-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:50 user nova-compute[75354]: INFO nova.compute.manager [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Neutron deleted interface d191d6b3-6ebb-460f-8403-49eb5a9fc0ca; detaching it from the instance and deleting it from the info cache
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.neutron [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.objects.instance [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Lazy-loading 'system_metadata' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquired lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.objects.instance [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Lazy-loading 'flavor' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.objects.base [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Object Instance<6b2df786-b4e7-4593-b73b-4ee8d54f92e6> lazy-loaded attributes: system_metadata,flavor {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Converting VIF {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface> {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 06:32:50 user nova-compute[75354]:   <name>instance-00000006</name>
Nov 14 06:32:50 user nova-compute[75354]:   <uuid>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</uuid>
Nov 14 06:32:50 user nova-compute[75354]:   <metadata>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:50 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:32:49</nova:creationTime>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:32:50 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:owner>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:owner>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:ports>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:32:50 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:32:50 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:ports>
Nov 14 06:32:50 user nova-compute[75354]: </nova:instance>
Nov 14 06:32:50 user nova-compute[75354]:   </metadata>
Nov 14 06:32:50 user nova-compute[75354]:   <memory unit='KiB'>524288</memory>
Nov 14 06:32:50 user nova-compute[75354]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 06:32:50 user nova-compute[75354]:   <vcpu placement='static'>1</vcpu>
Nov 14 06:32:50 user nova-compute[75354]:   <resource>
Nov 14 06:32:50 user nova-compute[75354]:     <partition>/machine</partition>
Nov 14 06:32:50 user nova-compute[75354]:   </resource>
Nov 14 06:32:50 user nova-compute[75354]:   <sysinfo type='smbios'>
Nov 14 06:32:50 user nova-compute[75354]:     <system>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='version'>0.0.0</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='serial'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='uuid'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='family'>Virtual Machine</entry>
Nov 14 06:32:50 user nova-compute[75354]:     </system>
Nov 14 06:32:50 user nova-compute[75354]:   </sysinfo>
Nov 14 06:32:50 user nova-compute[75354]:   <os>
Nov 14 06:32:50 user nova-compute[75354]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 06:32:50 user nova-compute[75354]:     <boot dev='hd'/>
Nov 14 06:32:50 user nova-compute[75354]:     <smbios mode='sysinfo'/>
Nov 14 06:32:50 user nova-compute[75354]:   </os>
Nov 14 06:32:50 user nova-compute[75354]:   <features>
Nov 14 06:32:50 user nova-compute[75354]:     <acpi/>
Nov 14 06:32:50 user nova-compute[75354]:     <apic/>
Nov 14 06:32:50 user nova-compute[75354]:     <vmcoreinfo state='on'/>
Nov 14 06:32:50 user nova-compute[75354]:   </features>
Nov 14 06:32:50 user nova-compute[75354]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 06:32:50 user nova-compute[75354]:     <model fallback='forbid'>Nehalem</model>
Nov 14 06:32:50 user nova-compute[75354]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 06:32:50 user nova-compute[75354]:     <feature policy='require' name='vme'/>
Nov 14 06:32:50 user nova-compute[75354]:     <feature policy='require' name='x2apic'/>
Nov 14 06:32:50 user nova-compute[75354]:     <feature policy='require' name='hypervisor'/>
Nov 14 06:32:50 user nova-compute[75354]:   </cpu>
Nov 14 06:32:50 user nova-compute[75354]:   <clock offset='utc'>
Nov 14 06:32:50 user nova-compute[75354]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 06:32:50 user nova-compute[75354]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 06:32:50 user nova-compute[75354]:     <timer name='hpet' present='no'/>
Nov 14 06:32:50 user nova-compute[75354]:   </clock>
Nov 14 06:32:50 user nova-compute[75354]:   <on_poweroff>destroy</on_poweroff>
Nov 14 06:32:50 user nova-compute[75354]:   <on_reboot>restart</on_reboot>
Nov 14 06:32:50 user nova-compute[75354]:   <on_crash>destroy</on_crash>
Nov 14 06:32:50 user nova-compute[75354]:   <devices>
Nov 14 06:32:50 user nova-compute[75354]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 06:32:50 user nova-compute[75354]:     <disk type='file' device='disk'>
Nov 14 06:32:50 user nova-compute[75354]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 06:32:50 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk' index='2'/>
Nov 14 06:32:50 user nova-compute[75354]:       <backingStore type='file' index='3'>
Nov 14 06:32:50 user nova-compute[75354]:         <format type='raw'/>
Nov 14 06:32:50 user nova-compute[75354]:         <source file='/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10'/>
Nov 14 06:32:50 user nova-compute[75354]:         <backingStore/>
Nov 14 06:32:50 user nova-compute[75354]:       </backingStore>
Nov 14 06:32:50 user nova-compute[75354]:       <target dev='vda' bus='virtio'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='virtio-disk0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </disk>
Nov 14 06:32:50 user nova-compute[75354]:     <disk type='file' device='cdrom'>
Nov 14 06:32:50 user nova-compute[75354]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 06:32:50 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config' index='1'/>
Nov 14 06:32:50 user nova-compute[75354]:       <backingStore/>
Nov 14 06:32:50 user nova-compute[75354]:       <target dev='hda' bus='ide'/>
Nov 14 06:32:50 user nova-compute[75354]:       <readonly/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='ide0-0-0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </disk>
Nov 14 06:32:50 user nova-compute[75354]:     <controller type='usb' index='0' model='none'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='usb'/>
Nov 14 06:32:50 user nova-compute[75354]:     </controller>
Nov 14 06:32:50 user nova-compute[75354]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='pci.0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </controller>
Nov 14 06:32:50 user nova-compute[75354]:     <controller type='ide' index='0'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='ide'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 06:32:50 user nova-compute[75354]:     </controller>
Nov 14 06:32:50 user nova-compute[75354]:     <interface type='ethernet'>
Nov 14 06:32:50 user nova-compute[75354]:       <mac address='fa:16:3e:43:a3:7d'/>
Nov 14 06:32:50 user nova-compute[75354]:       <target dev='tap11e84908-33'/>
Nov 14 06:32:50 user nova-compute[75354]:       <model type='virtio'/>
Nov 14 06:32:50 user nova-compute[75354]:       <mtu size='1442'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='net0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </interface>
Nov 14 06:32:50 user nova-compute[75354]:     <serial type='pty'>
Nov 14 06:32:50 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:50 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:50 user nova-compute[75354]:       <target type='isa-serial' port='0'>
Nov 14 06:32:50 user nova-compute[75354]:         <model name='isa-serial'/>
Nov 14 06:32:50 user nova-compute[75354]:       </target>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </serial>
Nov 14 06:32:50 user nova-compute[75354]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 06:32:50 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:50 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:50 user nova-compute[75354]:       <target type='serial' port='0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </console>
Nov 14 06:32:50 user nova-compute[75354]:     <input type='mouse' bus='ps2'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='input0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </input>
Nov 14 06:32:50 user nova-compute[75354]:     <input type='keyboard' bus='ps2'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='input1'/>
Nov 14 06:32:50 user nova-compute[75354]:     </input>
Nov 14 06:32:50 user nova-compute[75354]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 06:32:50 user nova-compute[75354]:       <listen type='address' address='0.0.0.0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </graphics>
Nov 14 06:32:50 user nova-compute[75354]:     <audio id='1' type='none'/>
Nov 14 06:32:50 user nova-compute[75354]:     <video>
Nov 14 06:32:50 user nova-compute[75354]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='video0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </video>
Nov 14 06:32:50 user nova-compute[75354]:     <memballoon model='virtio'>
Nov 14 06:32:50 user nova-compute[75354]:       <stats period='10'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='balloon0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </memballoon>
Nov 14 06:32:50 user nova-compute[75354]:     <rng model='virtio'>
Nov 14 06:32:50 user nova-compute[75354]:       <backend model='random'>/dev/urandom</backend>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='rng0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </rng>
Nov 14 06:32:50 user nova-compute[75354]:   </devices>
Nov 14 06:32:50 user nova-compute[75354]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 06:32:50 user nova-compute[75354]:     <label>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</label>
Nov 14 06:32:50 user nova-compute[75354]:     <imagelabel>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</imagelabel>
Nov 14 06:32:50 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:50 user nova-compute[75354]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 06:32:50 user nova-compute[75354]:     <label>+64055:+108</label>
Nov 14 06:32:50 user nova-compute[75354]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 06:32:50 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:50 user nova-compute[75354]: </domain>
Nov 14 06:32:50 user nova-compute[75354]:  {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface> {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:8d:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd191d6b3-6e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 06:32:50 user nova-compute[75354]:   <name>instance-00000006</name>
Nov 14 06:32:50 user nova-compute[75354]:   <uuid>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</uuid>
Nov 14 06:32:50 user nova-compute[75354]:   <metadata>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:50 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:32:49</nova:creationTime>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:32:50 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:owner>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:owner>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:ports>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:32:50 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:32:50 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:ports>
Nov 14 06:32:50 user nova-compute[75354]: </nova:instance>
Nov 14 06:32:50 user nova-compute[75354]:   </metadata>
Nov 14 06:32:50 user nova-compute[75354]:   <memory unit='KiB'>524288</memory>
Nov 14 06:32:50 user nova-compute[75354]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 06:32:50 user nova-compute[75354]:   <vcpu placement='static'>1</vcpu>
Nov 14 06:32:50 user nova-compute[75354]:   <resource>
Nov 14 06:32:50 user nova-compute[75354]:     <partition>/machine</partition>
Nov 14 06:32:50 user nova-compute[75354]:   </resource>
Nov 14 06:32:50 user nova-compute[75354]:   <sysinfo type='smbios'>
Nov 14 06:32:50 user nova-compute[75354]:     <system>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='version'>0.0.0</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='serial'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='uuid'>6b2df786-b4e7-4593-b73b-4ee8d54f92e6</entry>
Nov 14 06:32:50 user nova-compute[75354]:       <entry name='family'>Virtual Machine</entry>
Nov 14 06:32:50 user nova-compute[75354]:     </system>
Nov 14 06:32:50 user nova-compute[75354]:   </sysinfo>
Nov 14 06:32:50 user nova-compute[75354]:   <os>
Nov 14 06:32:50 user nova-compute[75354]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 06:32:50 user nova-compute[75354]:     <boot dev='hd'/>
Nov 14 06:32:50 user nova-compute[75354]:     <smbios mode='sysinfo'/>
Nov 14 06:32:50 user nova-compute[75354]:   </os>
Nov 14 06:32:50 user nova-compute[75354]:   <features>
Nov 14 06:32:50 user nova-compute[75354]:     <acpi/>
Nov 14 06:32:50 user nova-compute[75354]:     <apic/>
Nov 14 06:32:50 user nova-compute[75354]:     <vmcoreinfo state='on'/>
Nov 14 06:32:50 user nova-compute[75354]:   </features>
Nov 14 06:32:50 user nova-compute[75354]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 06:32:50 user nova-compute[75354]:     <model fallback='forbid'>Nehalem</model>
Nov 14 06:32:50 user nova-compute[75354]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 06:32:50 user nova-compute[75354]:     <feature policy='require' name='vme'/>
Nov 14 06:32:50 user nova-compute[75354]:     <feature policy='require' name='x2apic'/>
Nov 14 06:32:50 user nova-compute[75354]:     <feature policy='require' name='hypervisor'/>
Nov 14 06:32:50 user nova-compute[75354]:   </cpu>
Nov 14 06:32:50 user nova-compute[75354]:   <clock offset='utc'>
Nov 14 06:32:50 user nova-compute[75354]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 06:32:50 user nova-compute[75354]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 06:32:50 user nova-compute[75354]:     <timer name='hpet' present='no'/>
Nov 14 06:32:50 user nova-compute[75354]:   </clock>
Nov 14 06:32:50 user nova-compute[75354]:   <on_poweroff>destroy</on_poweroff>
Nov 14 06:32:50 user nova-compute[75354]:   <on_reboot>restart</on_reboot>
Nov 14 06:32:50 user nova-compute[75354]:   <on_crash>destroy</on_crash>
Nov 14 06:32:50 user nova-compute[75354]:   <devices>
Nov 14 06:32:50 user nova-compute[75354]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 06:32:50 user nova-compute[75354]:     <disk type='file' device='disk'>
Nov 14 06:32:50 user nova-compute[75354]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 06:32:50 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk' index='2'/>
Nov 14 06:32:50 user nova-compute[75354]:       <backingStore type='file' index='3'>
Nov 14 06:32:50 user nova-compute[75354]:         <format type='raw'/>
Nov 14 06:32:50 user nova-compute[75354]:         <source file='/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10'/>
Nov 14 06:32:50 user nova-compute[75354]:         <backingStore/>
Nov 14 06:32:50 user nova-compute[75354]:       </backingStore>
Nov 14 06:32:50 user nova-compute[75354]:       <target dev='vda' bus='virtio'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='virtio-disk0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </disk>
Nov 14 06:32:50 user nova-compute[75354]:     <disk type='file' device='cdrom'>
Nov 14 06:32:50 user nova-compute[75354]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 06:32:50 user nova-compute[75354]:       <source file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/disk.config' index='1'/>
Nov 14 06:32:50 user nova-compute[75354]:       <backingStore/>
Nov 14 06:32:50 user nova-compute[75354]:       <target dev='hda' bus='ide'/>
Nov 14 06:32:50 user nova-compute[75354]:       <readonly/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='ide0-0-0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </disk>
Nov 14 06:32:50 user nova-compute[75354]:     <controller type='usb' index='0' model='none'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='usb'/>
Nov 14 06:32:50 user nova-compute[75354]:     </controller>
Nov 14 06:32:50 user nova-compute[75354]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='pci.0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </controller>
Nov 14 06:32:50 user nova-compute[75354]:     <controller type='ide' index='0'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='ide'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 06:32:50 user nova-compute[75354]:     </controller>
Nov 14 06:32:50 user nova-compute[75354]:     <interface type='ethernet'>
Nov 14 06:32:50 user nova-compute[75354]:       <mac address='fa:16:3e:43:a3:7d'/>
Nov 14 06:32:50 user nova-compute[75354]:       <target dev='tap11e84908-33'/>
Nov 14 06:32:50 user nova-compute[75354]:       <model type='virtio'/>
Nov 14 06:32:50 user nova-compute[75354]:       <mtu size='1442'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='net0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </interface>
Nov 14 06:32:50 user nova-compute[75354]:     <serial type='pty'>
Nov 14 06:32:50 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:50 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:50 user nova-compute[75354]:       <target type='isa-serial' port='0'>
Nov 14 06:32:50 user nova-compute[75354]:         <model name='isa-serial'/>
Nov 14 06:32:50 user nova-compute[75354]:       </target>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </serial>
Nov 14 06:32:50 user nova-compute[75354]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 06:32:50 user nova-compute[75354]:       <source path='/dev/pts/5'/>
Nov 14 06:32:50 user nova-compute[75354]:       <log file='/opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6/console.log' append='off'/>
Nov 14 06:32:50 user nova-compute[75354]:       <target type='serial' port='0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='serial0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </console>
Nov 14 06:32:50 user nova-compute[75354]:     <input type='mouse' bus='ps2'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='input0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </input>
Nov 14 06:32:50 user nova-compute[75354]:     <input type='keyboard' bus='ps2'>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='input1'/>
Nov 14 06:32:50 user nova-compute[75354]:     </input>
Nov 14 06:32:50 user nova-compute[75354]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 06:32:50 user nova-compute[75354]:       <listen type='address' address='0.0.0.0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </graphics>
Nov 14 06:32:50 user nova-compute[75354]:     <audio id='1' type='none'/>
Nov 14 06:32:50 user nova-compute[75354]:     <video>
Nov 14 06:32:50 user nova-compute[75354]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='video0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </video>
Nov 14 06:32:50 user nova-compute[75354]:     <memballoon model='virtio'>
Nov 14 06:32:50 user nova-compute[75354]:       <stats period='10'/>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='balloon0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </memballoon>
Nov 14 06:32:50 user nova-compute[75354]:     <rng model='virtio'>
Nov 14 06:32:50 user nova-compute[75354]:       <backend model='random'>/dev/urandom</backend>
Nov 14 06:32:50 user nova-compute[75354]:       <alias name='rng0'/>
Nov 14 06:32:50 user nova-compute[75354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 06:32:50 user nova-compute[75354]:     </rng>
Nov 14 06:32:50 user nova-compute[75354]:   </devices>
Nov 14 06:32:50 user nova-compute[75354]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 06:32:50 user nova-compute[75354]:     <label>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</label>
Nov 14 06:32:50 user nova-compute[75354]:     <imagelabel>libvirt-6b2df786-b4e7-4593-b73b-4ee8d54f92e6</imagelabel>
Nov 14 06:32:50 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:50 user nova-compute[75354]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 06:32:50 user nova-compute[75354]:     <label>+64055:+108</label>
Nov 14 06:32:50 user nova-compute[75354]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 06:32:50 user nova-compute[75354]:   </seclabel>
Nov 14 06:32:50 user nova-compute[75354]: </domain>
Nov 14 06:32:50 user nova-compute[75354]:  {{(pid=75354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 06:32:50 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Detaching interface fa:16:3e:d8:8d:3a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapd191d6b3-6e' not found.
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Converting VIF {"id": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "address": "fa:16:3e:d8:8d:3a", "network": {"id": "a079fca2-f95d-4601-b758-f6041c442e1f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1205263370", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd191d6b3-6e", "ovs_interfaceid": "d191d6b3-6ebb-460f-8403-49eb5a9fc0ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG os_vif [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd191d6b3-6e, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:32:50 user nova-compute[75354]: INFO os_vif [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8d:3a,bridge_name='br-int',has_traffic_filtering=True,id=d191d6b3-6ebb-460f-8403-49eb5a9fc0ca,network=Network(a079fca2-f95d-4601-b758-f6041c442e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd191d6b3-6e')
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [req-ea88048b-97c2-45f3-a756-13880952cf86 req-4e02941f-66f8-4851-8123-85ee4024eed4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:50 user nova-compute[75354]:   <nova:package version="0.0.0"/>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:name>tempest-device-tagging-server-71961894</nova:name>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:creationTime>2023-11-14 06:32:50</nova:creationTime>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:flavor name="m1.tiny">
Nov 14 06:32:50 user nova-compute[75354]:     <nova:memory>512</nova:memory>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:disk>1</nova:disk>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:swap>0</nova:swap>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:flavor>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:owner>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:user uuid="5ca6db752d9740d396768a204f73874f">tempest-TaggedAttachmentsTest-778201428-project-member</nova:user>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:project uuid="5ad9cd240eea481eb57ebf0a143f237e">tempest-TaggedAttachmentsTest-778201428</nova:project>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:owner>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:50 user nova-compute[75354]:   <nova:ports>
Nov 14 06:32:50 user nova-compute[75354]:     <nova:port uuid="11e84908-3332-4724-b02f-2c747cfd3dba">
Nov 14 06:32:50 user nova-compute[75354]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:32:50 user nova-compute[75354]:     </nova:port>
Nov 14 06:32:50 user nova-compute[75354]:   </nova:ports>
Nov 14 06:32:50 user nova-compute[75354]: </nova:instance>
Nov 14 06:32:50 user nova-compute[75354]:  {{(pid=75354) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:32:50 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:32:50 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Creating image(s)
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "/opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "/opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "/opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk 1073741824" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.policy [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdace4f11a3f4e95862b8c979e82d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1f7375b4ed4d649edad03899ab4446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Cannot resize image /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Ensure instance console log exists: /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [{"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Releasing lock "refresh_cache-6b2df786-b4e7-4593-b73b-4ee8d54f92e6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dca6a1e6-49c4-4ab5-b3c0-3e756be1cc7b tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "interface-6b2df786-b4e7-4593-b73b-4ee8d54f92e6-d191d6b3-6ebb-460f-8403-49eb5a9fc0ca" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.653s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:51 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Successfully created port: 5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Successfully updated port: 5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "refresh_cache-afb399e4-fd36-455d-b7c7-ac160f32ce79" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquired lock "refresh_cache-afb399e4-fd36-455d-b7c7-ac160f32ce79" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Received event network-changed-5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Refreshing instance network info cache due to event network-changed-5acecc8d-5c66-4713-a01e-663b1241309b. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] Acquiring lock "refresh_cache-afb399e4-fd36-455d-b7c7-ac160f32ce79" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Updating instance_info_cache with network_info: [{"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Releasing lock "refresh_cache-afb399e4-fd36-455d-b7c7-ac160f32ce79" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Instance network_info: |[{"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] Acquired lock "refresh_cache-afb399e4-fd36-455d-b7c7-ac160f32ce79" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Refreshing network info cache for port 5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Start _get_guest_xml network_info=[{"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:32:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:32:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-726907842',display_name='tempest-VolumesAdminNegativeTest-server-726907842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-726907842',id=12,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f1f7375b4ed4d649edad03899ab4446',ramdisk_id='',reservation_id='r-bdz2kq1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1431300602',owner_user_name='tempest-VolumesAdminNegativeTest-1431300602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:32:50Z,user_data=None,user_id='fdace4f11a3f4e95862b8c979e82d7ab',uuid=afb399e4-fd36-455d-b7c7-ac160f32ce79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converting VIF {"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'pci_devices' on Instance uuid afb399e4-fd36-455d-b7c7-ac160f32ce79 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:32:52 user nova-compute[75354]:   <uuid>afb399e4-fd36-455d-b7c7-ac160f32ce79</uuid>
Nov 14 06:32:52 user nova-compute[75354]:   <name>instance-0000000c</name>
Nov 14 06:32:52 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:32:52 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:32:52 user nova-compute[75354]:   <metadata>
Nov 14 06:32:52 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:32:52 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:32:52 user nova-compute[75354]:       <nova:name>tempest-VolumesAdminNegativeTest-server-726907842</nova:name>
Nov 14 06:32:52 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:32:52</nova:creationTime>
Nov 14 06:32:52 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:32:52 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:32:52 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:32:52 user nova-compute[75354]:       <nova:owner>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:user uuid="fdace4f11a3f4e95862b8c979e82d7ab">tempest-VolumesAdminNegativeTest-1431300602-project-member</nova:user>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:project uuid="7f1f7375b4ed4d649edad03899ab4446">tempest-VolumesAdminNegativeTest-1431300602</nova:project>
Nov 14 06:32:52 user nova-compute[75354]:       </nova:owner>
Nov 14 06:32:52 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:32:52 user nova-compute[75354]:       <nova:ports>
Nov 14 06:32:52 user nova-compute[75354]:         <nova:port uuid="5acecc8d-5c66-4713-a01e-663b1241309b">
Nov 14 06:32:52 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 06:32:52 user nova-compute[75354]:         </nova:port>
Nov 14 06:32:52 user nova-compute[75354]:       </nova:ports>
Nov 14 06:32:52 user nova-compute[75354]:     </nova:instance>
Nov 14 06:32:52 user nova-compute[75354]:   </metadata>
Nov 14 06:32:52 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:32:52 user nova-compute[75354]:     <system>
Nov 14 06:32:52 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:32:52 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:32:52 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:32:52 user nova-compute[75354]:       <entry name="serial">afb399e4-fd36-455d-b7c7-ac160f32ce79</entry>
Nov 14 06:32:52 user nova-compute[75354]:       <entry name="uuid">afb399e4-fd36-455d-b7c7-ac160f32ce79</entry>
Nov 14 06:32:52 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:32:52 user nova-compute[75354]:     </system>
Nov 14 06:32:52 user nova-compute[75354]:   </sysinfo>
Nov 14 06:32:52 user nova-compute[75354]:   <os>
Nov 14 06:32:52 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:32:52 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:32:52 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:32:52 user nova-compute[75354]:   </os>
Nov 14 06:32:52 user nova-compute[75354]:   <features>
Nov 14 06:32:52 user nova-compute[75354]:     <acpi/>
Nov 14 06:32:52 user nova-compute[75354]:     <apic/>
Nov 14 06:32:52 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:32:52 user nova-compute[75354]:   </features>
Nov 14 06:32:52 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:32:52 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:32:52 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:32:52 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:32:52 user nova-compute[75354]:   </clock>
Nov 14 06:32:52 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:32:52 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:32:52 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:32:52 user nova-compute[75354]:   </cpu>
Nov 14 06:32:52 user nova-compute[75354]:   <devices>
Nov 14 06:32:52 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:32:52 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:32:52 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk"/>
Nov 14 06:32:52 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:32:52 user nova-compute[75354]:     </disk>
Nov 14 06:32:52 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:32:52 user nova-compute[75354]:       <mac address="fa:16:3e:00:50:46"/>
Nov 14 06:32:52 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:32:52 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:32:52 user nova-compute[75354]:       <target dev="tap5acecc8d-5c"/>
Nov 14 06:32:52 user nova-compute[75354]:     </interface>
Nov 14 06:32:52 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:32:52 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/console.log" append="off"/>
Nov 14 06:32:52 user nova-compute[75354]:     </serial>
Nov 14 06:32:52 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:32:52 user nova-compute[75354]:     <video>
Nov 14 06:32:52 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:32:52 user nova-compute[75354]:     </video>
Nov 14 06:32:52 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:32:52 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:32:52 user nova-compute[75354]:     </rng>
Nov 14 06:32:52 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:32:52 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:32:52 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:32:52 user nova-compute[75354]:     </memballoon>
Nov 14 06:32:52 user nova-compute[75354]:   </devices>
Nov 14 06:32:52 user nova-compute[75354]: </domain>
Nov 14 06:32:52 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-726907842',display_name='tempest-VolumesAdminNegativeTest-server-726907842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-726907842',id=12,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f1f7375b4ed4d649edad03899ab4446',ramdisk_id='',reservation_id='r-bdz2kq1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1431300602',owner_user_name='tempest-VolumesAdminNegativeTest-1431300602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:32:50Z,user_data=None,user_id='fdace4f11a3f4e95862b8c979e82d7ab',uuid=afb399e4-fd36-455d-b7c7-ac160f32ce79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converting VIF {"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG os_vif [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a36eebed-a1f5-5cdc-98e0-f7f47c15efdf', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5acecc8d-5c, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5acecc8d-5c, col_values=(('qos', UUID('73875902-6283-420d-8f5c-d2e021921643')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5acecc8d-5c, col_values=(('external_ids', {'iface-id': '5acecc8d-5c66-4713-a01e-663b1241309b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:50:46', 'vm-uuid': 'afb399e4-fd36-455d-b7c7-ac160f32ce79'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:32:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:52 user nova-compute[75354]: INFO os_vif [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c')
Nov 14 06:32:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:32:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] No VIF found with MAC fa:16:3e:00:50:46, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:32:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Updated VIF entry in instance network info cache for port 5acecc8d-5c66-4713-a01e-663b1241309b. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:32:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Updating instance_info_cache with network_info: [{"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:32:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-37d1d707-52ca-4400-b0e3-6b0cdec37156 req-9da2a87c-9b62-4674-82a1-1369d602aeb0 service nova] Releasing lock "refresh_cache-afb399e4-fd36-455d-b7c7-ac160f32ce79" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-5387724c-ce41-4db5-994c-1b03d07f8fe5 req-378a925b-5c9d-4244-81d5-54c88595ac3e service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Received event network-vif-plugged-5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5387724c-ce41-4db5-994c-1b03d07f8fe5 req-378a925b-5c9d-4244-81d5-54c88595ac3e service nova] Acquiring lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5387724c-ce41-4db5-994c-1b03d07f8fe5 req-378a925b-5c9d-4244-81d5-54c88595ac3e service nova] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5387724c-ce41-4db5-994c-1b03d07f8fe5 req-378a925b-5c9d-4244-81d5-54c88595ac3e service nova] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-5387724c-ce41-4db5-994c-1b03d07f8fe5 req-378a925b-5c9d-4244-81d5-54c88595ac3e service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] No waiting events found dispatching network-vif-plugged-5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:54 user nova-compute[75354]: WARNING nova.compute.manager [req-5387724c-ce41-4db5-994c-1b03d07f8fe5 req-378a925b-5c9d-4244-81d5-54c88595ac3e service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Received unexpected event network-vif-plugged-5acecc8d-5c66-4713-a01e-663b1241309b for instance with vm_state building and task_state spawning.
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:32:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Instance spawned successfully.
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:32:56 user nova-compute[75354]: INFO nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:32:56 user nova-compute[75354]: INFO nova.compute.manager [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Took 6.65 seconds to build instance.
Nov 14 06:32:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8c41b45f-0651-4573-b30d-e4ae89ddd1e8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.754s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-095eb3d1-6c47-4625-bb0e-34a07cb21c58 req-7fc3d7ef-d60c-4397-a64f-30897faab027 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Received event network-vif-plugged-5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-095eb3d1-6c47-4625-bb0e-34a07cb21c58 req-7fc3d7ef-d60c-4397-a64f-30897faab027 service nova] Acquiring lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-095eb3d1-6c47-4625-bb0e-34a07cb21c58 req-7fc3d7ef-d60c-4397-a64f-30897faab027 service nova] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-095eb3d1-6c47-4625-bb0e-34a07cb21c58 req-7fc3d7ef-d60c-4397-a64f-30897faab027 service nova] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:32:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-095eb3d1-6c47-4625-bb0e-34a07cb21c58 req-7fc3d7ef-d60c-4397-a64f-30897faab027 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] No waiting events found dispatching network-vif-plugged-5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:32:56 user nova-compute[75354]: WARNING nova.compute.manager [req-095eb3d1-6c47-4625-bb0e-34a07cb21c58 req-7fc3d7ef-d60c-4397-a64f-30897faab027 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Received unexpected event network-vif-plugged-5acecc8d-5c66-4713-a01e-663b1241309b for instance with vm_state active and task_state None.
Nov 14 06:32:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:32:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:33:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:33:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:33:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:07 user nova-compute[75354]: INFO nova.compute.manager [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Terminating instance
Nov 14 06:33:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-f48b8770-ccde-4635-b7fb-eb4f7bd2acb2 req-b8317a1a-572a-4ae7-8726-a121c4b58123 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-vif-unplugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f48b8770-ccde-4635-b7fb-eb4f7bd2acb2 req-b8317a1a-572a-4ae7-8726-a121c4b58123 service nova] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f48b8770-ccde-4635-b7fb-eb4f7bd2acb2 req-b8317a1a-572a-4ae7-8726-a121c4b58123 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f48b8770-ccde-4635-b7fb-eb4f7bd2acb2 req-b8317a1a-572a-4ae7-8726-a121c4b58123 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-f48b8770-ccde-4635-b7fb-eb4f7bd2acb2 req-b8317a1a-572a-4ae7-8726-a121c4b58123 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] No waiting events found dispatching network-vif-unplugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-f48b8770-ccde-4635-b7fb-eb4f7bd2acb2 req-b8317a1a-572a-4ae7-8726-a121c4b58123 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-vif-unplugged-924b8fb4-50d6-4ec2-a462-8395186b525a for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:33:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Instance destroyed successfully.
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lazy-loading 'resources' on Instance uuid 9677bd15-7e09-41db-8f75-0da15ac5d426 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1293286398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1293286',id=8,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/qWvQ0ETh8J1EmSu2VQClnifiUHIPfkAkgJ4iYM7I5bZUTbiA2F620RzkYHtAHrG0L4sJNGTfBFDzIq+FJSb9RfJOnTvYWluKVxJTbk1JS2SQIy4rd4PQTL+qGbaEdg==',key_name='tempest-keypair-1561745228',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56caa1b81fcd45bab0f82a66c05352ff',ramdisk_id='',reservation_id='r-8thhowdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1481112930',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46afb46ec94745f18b5a7f6a18b3aa63',uuid=9677bd15-7e09-41db-8f75-0da15ac5d426,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Converting VIF {"id": "924b8fb4-50d6-4ec2-a462-8395186b525a", "address": "fa:16:3e:c2:c8:76", "network": {"id": "d9d2d417-a148-4f98-a29f-75d30b035338", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-70924524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56caa1b81fcd45bab0f82a66c05352ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b8fb4-50", "ovs_interfaceid": "924b8fb4-50d6-4ec2-a462-8395186b525a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG os_vif [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap924b8fb4-50, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5a63081-254a-4100-9c83-0fde65341d64) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:08 user nova-compute[75354]: INFO os_vif [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:c8:76,bridge_name='br-int',has_traffic_filtering=True,id=924b8fb4-50d6-4ec2-a462-8395186b525a,network=Network(d9d2d417-a148-4f98-a29f-75d30b035338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b8fb4-50')
Nov 14 06:33:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Deleting instance files /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426_del
Nov 14 06:33:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Deletion of /opt/stack/data/nova/instances/9677bd15-7e09-41db-8f75-0da15ac5d426_del complete
Nov 14 06:33:08 user nova-compute[75354]: INFO nova.compute.manager [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 06:33:08 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:33:08 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:33:09 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:09 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Took 0.93 seconds to deallocate network for instance.
Nov 14 06:33:09 user nova-compute[75354]: DEBUG nova.compute.manager [req-ca077583-8dc2-4aad-b0b9-34ac46e6521f req-8a4b5b3b-267a-42a8-908d-58009db15396 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-vif-deleted-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:09 user nova-compute[75354]: INFO nova.compute.manager [req-ca077583-8dc2-4aad-b0b9-34ac46e6521f req-8a4b5b3b-267a-42a8-908d-58009db15396 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Neutron deleted interface 924b8fb4-50d6-4ec2-a462-8395186b525a; detaching it from the instance and deleting it from the info cache
Nov 14 06:33:09 user nova-compute[75354]: DEBUG nova.network.neutron [req-ca077583-8dc2-4aad-b0b9-34ac46e6521f req-8a4b5b3b-267a-42a8-908d-58009db15396 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:09 user nova-compute[75354]: DEBUG nova.compute.manager [req-ca077583-8dc2-4aad-b0b9-34ac46e6521f req-8a4b5b3b-267a-42a8-908d-58009db15396 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Detach interface failed, port_id=924b8fb4-50d6-4ec2-a462-8395186b525a, reason: Instance 9677bd15-7e09-41db-8f75-0da15ac5d426 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:33:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:10 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Deleted allocations for instance 9677bd15-7e09-41db-8f75-0da15ac5d426
Nov 14 06:33:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8afb4073-10d0-4bff-8d64-c97de130659d tempest-TestServerVolumeAttachScenarioOldVersion-1481112930 tempest-TestServerVolumeAttachScenarioOldVersion-1481112930-project-member] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-8e282329-ef3f-4a43-8873-514bddefbf02 req-f795ecf0-af32-4f69-8d58-5982accb9ce4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received event network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8e282329-ef3f-4a43-8873-514bddefbf02 req-f795ecf0-af32-4f69-8d58-5982accb9ce4 service nova] Acquiring lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8e282329-ef3f-4a43-8873-514bddefbf02 req-f795ecf0-af32-4f69-8d58-5982accb9ce4 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8e282329-ef3f-4a43-8873-514bddefbf02 req-f795ecf0-af32-4f69-8d58-5982accb9ce4 service nova] Lock "9677bd15-7e09-41db-8f75-0da15ac5d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-8e282329-ef3f-4a43-8873-514bddefbf02 req-f795ecf0-af32-4f69-8d58-5982accb9ce4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] No waiting events found dispatching network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:10 user nova-compute[75354]: WARNING nova.compute.manager [req-8e282329-ef3f-4a43-8873-514bddefbf02 req-f795ecf0-af32-4f69-8d58-5982accb9ce4 service nova] [instance: 9677bd15-7e09-41db-8f75-0da15ac5d426] Received unexpected event network-vif-plugged-924b8fb4-50d6-4ec2-a462-8395186b525a for instance with vm_state deleted and task_state None.
Nov 14 06:33:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:11 user nova-compute[75354]: INFO nova.compute.manager [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Terminating instance
Nov 14 06:33:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-bc6d6091-bbba-464f-8c05-042475673c99 req-310510ca-1935-4ab2-afac-6743989ba3cd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-vif-unplugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bc6d6091-bbba-464f-8c05-042475673c99 req-310510ca-1935-4ab2-afac-6743989ba3cd service nova] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bc6d6091-bbba-464f-8c05-042475673c99 req-310510ca-1935-4ab2-afac-6743989ba3cd service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bc6d6091-bbba-464f-8c05-042475673c99 req-310510ca-1935-4ab2-afac-6743989ba3cd service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-bc6d6091-bbba-464f-8c05-042475673c99 req-310510ca-1935-4ab2-afac-6743989ba3cd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] No waiting events found dispatching network-vif-unplugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-bc6d6091-bbba-464f-8c05-042475673c99 req-310510ca-1935-4ab2-afac-6743989ba3cd service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-vif-unplugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:33:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Instance destroyed successfully.
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lazy-loading 'resources' on Instance uuid 3ef09cb8-e642-4810-a2fe-aa4d79c055c4 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1413122735',display_name='tempest-VolumesAssistedSnapshotsTest-server-1413122735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1413122735',id=9,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEndu3huhL7L31cD2w6pr2dkJ/zYBLS8d9g9gukPa20HHSr9aNn8xazNFKnR3MljJqN5JWWd+FOct9lqI+dY4Ub8qoRv3wlp55WM6KMukYDyPu2CIdPPQKBJ5Frr0pEDXQ==',key_name='tempest-keypair-595419698',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aa38efc664842d9bcbf971a2d999e26',ramdisk_id='',reservation_id='r-kcsnebht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-247248921',owner_user_name='tempest-VolumesAssistedSnapshotsTest-247248921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab28d1deda014d2195e3cda963729eeb',uuid=3ef09cb8-e642-4810-a2fe-aa4d79c055c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Converting VIF {"id": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "address": "fa:16:3e:8a:81:de", "network": {"id": "da393800-3631-43a6-887d-de3459ebd674", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1224547040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aa38efc664842d9bcbf971a2d999e26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde150d79-f1", "ovs_interfaceid": "de150d79-f1d1-4f35-9cd8-e7fef54c20c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG os_vif [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde150d79-f1, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2889bf50-80a6-45f2-b6a0-3daf20d71c88) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:12 user nova-compute[75354]: INFO os_vif [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:81:de,bridge_name='br-int',has_traffic_filtering=True,id=de150d79-f1d1-4f35-9cd8-e7fef54c20c1,network=Network(da393800-3631-43a6-887d-de3459ebd674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde150d79-f1')
Nov 14 06:33:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Deleting instance files /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4_del
Nov 14 06:33:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Deletion of /opt/stack/data/nova/instances/3ef09cb8-e642-4810-a2fe-aa4d79c055c4_del complete
Nov 14 06:33:12 user nova-compute[75354]: INFO nova.compute.manager [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 06:33:12 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:33:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:13 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:13 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Took 0.84 seconds to deallocate network for instance.
Nov 14 06:33:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:13 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:13 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:13 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Deleted allocations for instance 3ef09cb8-e642-4810-a2fe-aa4d79c055c4
Nov 14 06:33:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d5d5a214-a645-4c9d-b955-e528118b3f97 tempest-VolumesAssistedSnapshotsTest-247248921 tempest-VolumesAssistedSnapshotsTest-247248921-project-member] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] Acquiring lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] Lock "3ef09cb8-e642-4810-a2fe-aa4d79c055c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] No waiting events found dispatching network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:14 user nova-compute[75354]: WARNING nova.compute.manager [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received unexpected event network-vif-plugged-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 for instance with vm_state deleted and task_state None.
Nov 14 06:33:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-63be4ad0-595a-45b6-a425-be883715f7f1 req-8607e03d-2b4d-4751-85f5-b2fb24045e5e service nova] [instance: 3ef09cb8-e642-4810-a2fe-aa4d79c055c4] Received event network-vif-deleted-de150d79-f1d1-4f35-9cd8-e7fef54c20c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'flavor' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:19 user nova-compute[75354]: INFO nova.compute.manager [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Terminating instance
Nov 14 06:33:19 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:20 user nova-compute[75354]: INFO nova.compute.manager [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Attaching volume 6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf to /dev/vdb
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_brick.utils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab51aa76-cc59-4c00-aa70-6fa7da62fffe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d479749-6c31-498a-be8a-70543b3fcfda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[105884a0-80e4-435e-8f78-e393431b6994]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[86605f71-0641-4375-9b78-f8096c6a472a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:33:20 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4022cc3-2253-4411-833e-b539923c5873]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_brick.utils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating existing volume attachment record: 6da4c7f6-0930-42c4-9dcf-2a9e84fb3862 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-9d22a5ca-eb71-4048-9fe0-30f12f32745d req-22d743a2-4ca3-4d51-8c62-bad44decf41e service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-unplugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9d22a5ca-eb71-4048-9fe0-30f12f32745d req-22d743a2-4ca3-4d51-8c62-bad44decf41e service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9d22a5ca-eb71-4048-9fe0-30f12f32745d req-22d743a2-4ca3-4d51-8c62-bad44decf41e service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9d22a5ca-eb71-4048-9fe0-30f12f32745d req-22d743a2-4ca3-4d51-8c62-bad44decf41e service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-9d22a5ca-eb71-4048-9fe0-30f12f32745d req-22d743a2-4ca3-4d51-8c62-bad44decf41e service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-unplugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-9d22a5ca-eb71-4048-9fe0-30f12f32745d req-22d743a2-4ca3-4d51-8c62-bad44decf41e service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-unplugged-11e84908-3332-4724-b02f-2c747cfd3dba for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Instance destroyed successfully.
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.objects.instance [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lazy-loading 'resources' on Instance uuid 6b2df786-b4e7-4593-b73b-4ee8d54f92e6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T06:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71961894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71961894',id=6,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs2qKd3X6Nmes5Y+uWk+pOlYtPsmUgxVog36U0nI6M+TkVo3OS8gvTm5pusLVaPFia+ClaiAo9HT3S2vH8wqK08WKVIc+/qrcALZNm487ubU+1fyQ69EznHpfgDEnYbdg==',key_name='tempest-keypair-1519468776',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad9cd240eea481eb57ebf0a143f237e',ramdisk_id='',reservation_id='r-fhkve0p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-778201428',owner_user_name='tempest-TaggedAttachmentsTest-778201428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca6db752d9740d396768a204f73874f',uuid=6b2df786-b4e7-4593-b73b-4ee8d54f92e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converting VIF {"id": "11e84908-3332-4724-b02f-2c747cfd3dba", "address": "fa:16:3e:43:a3:7d", "network": {"id": "d6dc8cc7-898d-4c90-b833-154089746e41", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-757124043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad9cd240eea481eb57ebf0a143f237e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e84908-33", "ovs_interfaceid": "11e84908-3332-4724-b02f-2c747cfd3dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG os_vif [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11e84908-33, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42b88288-f268-444f-9fdd-112e8f076edd) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:20 user nova-compute[75354]: INFO os_vif [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a3:7d,bridge_name='br-int',has_traffic_filtering=True,id=11e84908-3332-4724-b02f-2c747cfd3dba,network=Network(d6dc8cc7-898d-4c90-b833-154089746e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e84908-33')
Nov 14 06:33:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Deleting instance files /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6_del
Nov 14 06:33:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Deletion of /opt/stack/data/nova/instances/6b2df786-b4e7-4593-b73b-4ee8d54f92e6_del complete
Nov 14 06:33:20 user nova-compute[75354]: INFO nova.compute.manager [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 06:33:20 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:33:20 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:33:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-3904adcc-559e-4950-b65b-8a138d6ca901 req-cf1df08d-be1b-4221-8f4e-5e0037a520d8 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3904adcc-559e-4950-b65b-8a138d6ca901 req-cf1df08d-be1b-4221-8f4e-5e0037a520d8 service nova] Acquiring lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3904adcc-559e-4950-b65b-8a138d6ca901 req-cf1df08d-be1b-4221-8f4e-5e0037a520d8 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3904adcc-559e-4950-b65b-8a138d6ca901 req-cf1df08d-be1b-4221-8f4e-5e0037a520d8 service nova] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-3904adcc-559e-4950-b65b-8a138d6ca901 req-cf1df08d-be1b-4221-8f4e-5e0037a520d8 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] No waiting events found dispatching network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:22 user nova-compute[75354]: WARNING nova.compute.manager [req-3904adcc-559e-4950-b65b-8a138d6ca901 req-cf1df08d-be1b-4221-8f4e-5e0037a520d8 service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received unexpected event network-vif-plugged-11e84908-3332-4724-b02f-2c747cfd3dba for instance with vm_state active and task_state deleting.
Nov 14 06:33:22 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:22 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Took 1.76 seconds to deallocate network for instance.
Nov 14 06:33:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:23 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:23 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:23 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Deleted allocations for instance 6b2df786-b4e7-4593-b73b-4ee8d54f92e6
Nov 14 06:33:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d557a5b-4cba-406c-8bf0-f776645c8e91 tempest-TaggedAttachmentsTest-778201428 tempest-TaggedAttachmentsTest-778201428-project-member] Lock "6b2df786-b4e7-4593-b73b-4ee8d54f92e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.449s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-0d79ce5a-f919-4a66-974b-c216e849b877 req-081421d9-2d92-407f-becb-62ed6198730c service nova] [instance: 6b2df786-b4e7-4593-b73b-4ee8d54f92e6] Received event network-vif-deleted-11e84908-3332-4724-b02f-2c747cfd3dba {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:25 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:25 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:25 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b951c16-c1b0-4ee3-86c6-da0cbd506d9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:33:25 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4d6cb-20cd-4ba4-92f1-ceab3345860b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf] added
Nov 14 06:33:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4376d4-537d-42f3-b567-24fac083182a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d126b4e6-5264-4b6f-bf05-3d4afc20e7d3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrIjaFCZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrIjaFCZ" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2a7ab2-35b1-41ac-82a2-d0071539c448]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrIjaFCZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66db6a1-f658-45e6-b1e7-95de0fadf0a1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[42044125-d175-495c-9f88-f7586bdbda63]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7905a6c-2ef8-4d7d-adee-42a7dc617b08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]
Nov 14 06:33:25 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.
Nov 14 06:33:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5200bcb-1c59-4ee2-8ab3-a3ee2afae527]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b81ca-bee5-44ed-863a-c11dbce8c09d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:25 user nova-compute[75354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc56a5c3-c8fa-404a-9298-6786faaef71c]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:33:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26333373239316430', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333373239316430', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'flavor' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:33:26 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:33:26 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:33:26 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:33:26 user nova-compute[75354]:   <serial>6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf</serial>
Nov 14 06:33:26 user nova-compute[75354]: </disk>
Nov 14 06:33:26 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:33:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No VIF found with MAC fa:16:3e:f8:4e:57, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ca4d7145-f353-4cb7-8ad3-fd4c3aa279c6 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.125s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8330MB free_disk=25.738502502441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:29 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating resource usage from migration 2aedc199-747b-4211-b631-8e996241c0dd
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b96beb17-09e1-45a2-8699-8657baa034e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 93429017-a737-45d4-965b-d7369a440bf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance afb399e4-fd36-455d-b7c7-ac160f32ce79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Migration 2aedc199-747b-4211-b631-8e996241c0dd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Stashing vm_state: active {{(pid=75354) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:33:30 user nova-compute[75354]: INFO nova.compute.claims [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Claim successful on node user
Nov 14 06:33:30 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating resource usage from migration 2aedc199-747b-4211-b631-8e996241c0dd
Nov 14 06:33:30 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.341s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:30 user nova-compute[75354]: INFO nova.compute.manager [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Migrating
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:30 user nova-compute[75354]: INFO nova.compute.rpcapi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Starting migrate_disk_and_power_off {{(pid=75354) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b080fd9b-09e4-42b8-9554-459ff4f43691 req-51813729-1b46-4963-9ec1-3f984edc0340 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b080fd9b-09e4-42b8-9554-459ff4f43691 req-51813729-1b46-4963-9ec1-3f984edc0340 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b080fd9b-09e4-42b8-9554-459ff4f43691 req-51813729-1b46-4963-9ec1-3f984edc0340 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b080fd9b-09e4-42b8-9554-459ff4f43691 req-51813729-1b46-4963-9ec1-3f984edc0340 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b080fd9b-09e4-42b8-9554-459ff4f43691 req-51813729-1b46-4963-9ec1-3f984edc0340 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:31 user nova-compute[75354]: WARNING nova.compute.manager [req-b080fd9b-09e4-42b8-9554-459ff4f43691 req-51813729-1b46-4963-9ec1-3f984edc0340 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state resize_migrating.
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'info_cache' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance destroyed successfully.
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307913af-88, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f062eacc-bf4b-43dd-b537-7d4d98945d03) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:31 user nova-compute[75354]: INFO os_vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88')
Nov 14 06:33:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:31 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3207219-d202-4e19-8bcc-a8c24d87d3bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:33:31 user nova-compute[75354]: No targets found.
Nov 14 06:33:31 user nova-compute[75354]: iSNS:
Nov 14 06:33:31 user nova-compute[75354]: No targets found.
Nov 14 06:33:31 user nova-compute[75354]: STATIC:
Nov 14 06:33:31 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:33:31 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:31 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:31 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:33:31 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:31 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:31 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:33:31 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:31 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:31 user nova-compute[75354]: FIRMWARE:
Nov 14 06:33:31 user nova-compute[75354]: No targets found.
Nov 14 06:33:31 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:33:31 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:33:31 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17088ebd-62ce-4868-9440-1dc01ae9fb6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f9edd-0b20-455a-836a-2cf158b385dc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:31 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:31 user nova-compute[75354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:31 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:31 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:31 user nova-compute[75354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:31 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80946743a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dc70cf-0a14-4509-8cf3-95df7496b0a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f77d7d-dda5-4a2d-81dc-ce5fdc9c9f01]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:31 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d5ec1-dd95-40cc-8112-6eb2fabe124e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f2d59-6572-43b5-be3a-39f8046ca938]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a867bfd-5fac-48f9-9cb4-729510929584]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b945ec78-0bbb-42a2-8787-d87953ebb9eb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]
Nov 14 06:33:32 user nova-compute[75354]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.
Nov 14 06:33:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf55970-34bd-4a4d-b943-f2ce2ecfaad6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== disconnect_volume: return (370ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.network.neutron [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance destroyed successfully.
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'resources' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedb76634-c7, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7b127e0-598e-4fcb-ae0d-7a8ac5e05f8e) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:32 user nova-compute[75354]: INFO os_vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7')
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe4236b-c99c-4b52-9a14-04d300067b03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:33:32 user nova-compute[75354]: No targets found.
Nov 14 06:33:32 user nova-compute[75354]: iSNS:
Nov 14 06:33:32 user nova-compute[75354]: No targets found.
Nov 14 06:33:32 user nova-compute[75354]: STATIC:
Nov 14 06:33:32 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:33:32 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:32 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:32 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:33:32 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:32 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:32 user nova-compute[75354]: FIRMWARE:
Nov 14 06:33:32 user nova-compute[75354]: No targets found.
Nov 14 06:33:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:33:32 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:33:32 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ee7ae7-d8e2-4900-a8dd-fddf948bb720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ef39d4-f85f-4917-ade2-564c9b0a2ce0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:32 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:32 user nova-compute[75354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f807421b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241'): ({'sdj'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Removing single pathed devices sdj {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0929f9-3e37-402d-b518-f9e84235554c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e518a43f-d150-4c63-baa2-eca887edd7ef]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flushing IO for device /dev/sdj {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9_resize/disk /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77485c8b-83b1-425b-864f-540f1c3d4ae1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba012fc3-df2f-4bb0-9603-1c76334fdb86]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] SCSI volumes sdj have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb21dce1-0698-41d5-b64f-d14e0cada8b8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ff4ec-c8d5-4ee2-ae99-5229dfe0c829]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]
Nov 14 06:33:32 user nova-compute[75354]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.
Nov 14 06:33:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fe90d7-771c-4994-a9aa-93d2b83efb2b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== disconnect_volume: return (385ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start _get_guest_xml network_info=[{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '68039fc4-3444-4768-aa9e-ba1cb521b5dd', 'attached_at': '', 'detached_at': '', 'volume_id': '6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'serial': '6e4ddb08-ad6c-4d7b-952a-5c9793268241'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '4e2a0c21-123d-4b8c-ba31-b5ace2f31b45', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'numa_topology' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:32 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b395b27a-e5f9-4be5-9c6d-6b2422e9e612]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:33:32 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ade142-2d21-4790-aad7-44109ed9035b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241] added
Nov 14 06:33:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0c131-d016-4ce3-9d14-718e8eebcec7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "cp -r /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9_resize/disk /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk" returned: 0 in 0.428s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9_resize/disk.info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk.info {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "cp -r /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9_resize/disk.info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk.info" returned: 0 in 0.034s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3c398-1c55-4870-9cca-479b0904d768]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXiBztOH {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXiBztOH" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1decdcb5-6e34-4cf1-991f-5f32a0c26694]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXiBztOH'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[486cd5ef-30fb-4fa1-8138-dbc373beedd6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d410f-0244-4662-b8b0-e09de8f4a9d2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee3135-24da-40b3-800f-d42fa4d3aacb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]
Nov 14 06:33:33 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.
Nov 14 06:33:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22c3f3-cae8-4e78-bda5-8bca70c791e2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1732b53d-0996-4afb-b923-f0db2b8222c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:33 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:33 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4984e6-8275-44a5-b20c-5d3f45d9639c]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-de1dcb17-7636-4371-a2f4-0ffe0b6b497f req-5cfdd1e1-854a-44ca-bf60-3011af515569 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-de1dcb17-7636-4371-a2f4-0ffe0b6b497f req-5cfdd1e1-854a-44ca-bf60-3011af515569 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-de1dcb17-7636-4371-a2f4-0ffe0b6b497f req-5cfdd1e1-854a-44ca-bf60-3011af515569 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-de1dcb17-7636-4371-a2f4-0ffe0b6b497f req-5cfdd1e1-854a-44ca-bf60-3011af515569 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-de1dcb17-7636-4371-a2f4-0ffe0b6b497f req-5cfdd1e1-854a-44ca-bf60-3011af515569 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:33 user nova-compute[75354]: WARNING nova.compute.manager [req-de1dcb17-7636-4371-a2f4-0ffe0b6b497f req-5cfdd1e1-854a-44ca-bf60-3011af515569 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state resize_migrating.
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23039323166336165', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039323166336165', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'pci_devices' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:33:34 user nova-compute[75354]:   <uuid>68039fc4-3444-4768-aa9e-ba1cb521b5dd</uuid>
Nov 14 06:33:34 user nova-compute[75354]:   <name>instance-00000002</name>
Nov 14 06:33:34 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:33:34 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:33:34 user nova-compute[75354]:   <metadata>
Nov 14 06:33:34 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:33:34 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:33:34 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeTestJSON-server-124393074</nova:name>
Nov 14 06:33:34 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:33:32</nova:creationTime>
Nov 14 06:33:34 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:33:34 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:33:34 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:33:34 user nova-compute[75354]:       <nova:owner>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:user uuid="43461d505f5f44d68823f9c9e67f1cf4">tempest-AttachVolumeTestJSON-1353209128-project-member</nova:user>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:project uuid="f809549aa1ea440abaef3e4ba37ca414">tempest-AttachVolumeTestJSON-1353209128</nova:project>
Nov 14 06:33:34 user nova-compute[75354]:       </nova:owner>
Nov 14 06:33:34 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:33:34 user nova-compute[75354]:       <nova:ports>
Nov 14 06:33:34 user nova-compute[75354]:         <nova:port uuid="edb76634-c756-41ed-ace4-5b82d24b5365">
Nov 14 06:33:34 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 06:33:34 user nova-compute[75354]:         </nova:port>
Nov 14 06:33:34 user nova-compute[75354]:       </nova:ports>
Nov 14 06:33:34 user nova-compute[75354]:     </nova:instance>
Nov 14 06:33:34 user nova-compute[75354]:   </metadata>
Nov 14 06:33:34 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:33:34 user nova-compute[75354]:     <system>
Nov 14 06:33:34 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:33:34 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:33:34 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:33:34 user nova-compute[75354]:       <entry name="serial">68039fc4-3444-4768-aa9e-ba1cb521b5dd</entry>
Nov 14 06:33:34 user nova-compute[75354]:       <entry name="uuid">68039fc4-3444-4768-aa9e-ba1cb521b5dd</entry>
Nov 14 06:33:34 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:33:34 user nova-compute[75354]:     </system>
Nov 14 06:33:34 user nova-compute[75354]:   </sysinfo>
Nov 14 06:33:34 user nova-compute[75354]:   <os>
Nov 14 06:33:34 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:33:34 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:33:34 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:33:34 user nova-compute[75354]:   </os>
Nov 14 06:33:34 user nova-compute[75354]:   <features>
Nov 14 06:33:34 user nova-compute[75354]:     <acpi/>
Nov 14 06:33:34 user nova-compute[75354]:     <apic/>
Nov 14 06:33:34 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:33:34 user nova-compute[75354]:   </features>
Nov 14 06:33:34 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:33:34 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:33:34 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:33:34 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:33:34 user nova-compute[75354]:   </clock>
Nov 14 06:33:34 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:33:34 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:33:34 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:33:34 user nova-compute[75354]:   </cpu>
Nov 14 06:33:34 user nova-compute[75354]:   <devices>
Nov 14 06:33:34 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:33:34 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:33:34 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk"/>
Nov 14 06:33:34 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:33:34 user nova-compute[75354]:     </disk>
Nov 14 06:33:34 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:33:34 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:33:34 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 06:33:34 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:33:34 user nova-compute[75354]:       <serial>6e4ddb08-ad6c-4d7b-952a-5c9793268241</serial>
Nov 14 06:33:34 user nova-compute[75354]:     </disk>
Nov 14 06:33:34 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:33:34 user nova-compute[75354]:       <mac address="fa:16:3e:1b:86:63"/>
Nov 14 06:33:34 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:34 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:33:34 user nova-compute[75354]:       <target dev="tapedb76634-c7"/>
Nov 14 06:33:34 user nova-compute[75354]:     </interface>
Nov 14 06:33:34 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:33:34 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/console.log" append="off"/>
Nov 14 06:33:34 user nova-compute[75354]:     </serial>
Nov 14 06:33:34 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:33:34 user nova-compute[75354]:     <video>
Nov 14 06:33:34 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:34 user nova-compute[75354]:     </video>
Nov 14 06:33:34 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:33:34 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:33:34 user nova-compute[75354]:     </rng>
Nov 14 06:33:34 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:33:34 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:33:34 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:33:34 user nova-compute[75354]:     </memballoon>
Nov 14 06:33:34 user nova-compute[75354]:   </devices>
Nov 14 06:33:34 user nova-compute[75354]: </domain>
Nov 14 06:33:34 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Port 307913af-8833-4c78-8600-a43bbc913f5a binding to destination host user is already ACTIVE {{(pid=75354) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.197s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:33:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Cannot resize image /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.objects.instance [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'migration_context' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.objects.base [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1d25310-fb52-5551-829a-15ef428fe434', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedb76634-c7, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedb76634-c7, col_values=(('qos', UUID('9a695901-6f27-4cb1-8a2f-395f3f7dda62')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedb76634-c7, col_values=(('external_ids', {'iface-id': 'edb76634-c756-41ed-ace4-5b82d24b5365', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:86:63', 'vm-uuid': '68039fc4-3444-4768-aa9e-ba1cb521b5dd'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:35 user nova-compute[75354]: INFO os_vif [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7')
Nov 14 06:33:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_brick.utils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb5e4b-7813-4ef8-8444-7e14dc8cde1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6b691a-131f-46b1-ab1d-262ddfc58f76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f79ac7-f832-4f92-842c-9ea95db9aaa1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee51a365-d6e7-421d-802a-976770c3018b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:33:35 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:33:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[16abf49d-7605-4ecb-87c0-ec59a288522b]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:33:35 user nova-compute[75354]: DEBUG os_brick.utils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating instance_info_cache with network_info: [{"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-93429017-a737-45d4-965b-d7369a440bf8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:33:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance rebooted successfully.
Nov 14 06:33:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-146d3304-6359-4d94-9089-10a797430091 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:33:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Starting finish_migration {{(pid=75354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:33:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Creating image(s)
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:33:41 user nova-compute[75354]: INFO nova.compute.claims [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Claim successful on node user
Nov 14 06:33:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.233s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk. size=21474836480 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk 21474836480 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk 21474836480" returned: 0 in 0.063s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Ensure instance console log exists: /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start _get_guest_xml network_info=[{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '787b732d-c4cc-4cf1-8069-6a8d0458b3b9', 'attached_at': '2023-11-14T06:33:41.000000', 'detached_at': '', 'volume_id': '6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'serial': '6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '887fd62f-23a6-4351-8dd2-1ee47e8516b6', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:41 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:41 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:41 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1098a85-eb36-4028-bf2b-92a5c8ece042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:33:41 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56643c9-9057-4267-914d-ee0693bc7af4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf] added
Nov 14 06:33:41 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735f74f-299e-4772-a82d-3c0851431086]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a708f2-9f38-40ca-ad25-e6252a3170e6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrIjaFCZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrIjaFCZ" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c3b8e-938d-4e76-bf6b-e1093f5a12eb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrIjaFCZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f8a8e-58a1-47ba-91fb-b76d626c0efa]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG nova.policy [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f141a1ef1b44b34b09a8f2f88d5af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601a7175bd194f79b4ae31d34f724de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef70b43-ec84-4676-bad2-382b41a6c79d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:41 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:41 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:41 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:41 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:33:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Creating image(s)
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:33:42 user nova-compute[75354]: INFO nova.compute.claims [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Claim successful on node user
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.218s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.200s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-d43f217e-f930-46a5-8756-0a54527a6223 req-9d71e10b-b1bf-4d8e-93b7-147598b3c6bb service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d43f217e-f930-46a5-8756-0a54527a6223 req-9d71e10b-b1bf-4d8e-93b7-147598b3c6bb service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d43f217e-f930-46a5-8756-0a54527a6223 req-9d71e10b-b1bf-4d8e-93b7-147598b3c6bb service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d43f217e-f930-46a5-8756-0a54527a6223 req-9d71e10b-b1bf-4d8e-93b7-147598b3c6bb service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-d43f217e-f930-46a5-8756-0a54527a6223 req-9d71e10b-b1bf-4d8e-93b7-147598b3c6bb service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:42 user nova-compute[75354]: WARNING nova.compute.manager [req-d43f217e-f930-46a5-8756-0a54527a6223 req-9d71e10b-b1bf-4d8e-93b7-147598b3c6bb service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state None.
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk 1073741824" returned: 0 in 0.072s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Cannot resize image /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Ensure instance console log exists: /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:33:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:33:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --login" returned: 0 in 1.078s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bea827-7d49-4789-880e-7e8ba2f00845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]
Nov 14 06:33:43 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.
Nov 14 06:33:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Successfully created port: 25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65e9c1-d040-4485-8b46-81ea68b2abc4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7ae53-2d72-43b9-bb5b-9df6a5f578d2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:43 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:43 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:43 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:43 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.389s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1edc21-055f-44d6-8a44-6a352cfceb44]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG nova.policy [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f141a1ef1b44b34b09a8f2f88d5af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601a7175bd194f79b4ae31d34f724de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:33:43 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Creating image(s)
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.218s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk 1073741824" returned: 0 in 0.062s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.208s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:33:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.429s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== connect_volume: return (2433ms) {'type': 'block', 'scsi_wwn': '26333373239316430', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333373239316430', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Cannot resize image /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Ensure instance console log exists: /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:33:44 user nova-compute[75354]:   <uuid>787b732d-c4cc-4cf1-8069-6a8d0458b3b9</uuid>
Nov 14 06:33:44 user nova-compute[75354]:   <name>instance-00000001</name>
Nov 14 06:33:44 user nova-compute[75354]:   <memory>2097152</memory>
Nov 14 06:33:44 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:33:44 user nova-compute[75354]:   <metadata>
Nov 14 06:33:44 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:33:44 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:33:44 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherB-server-924171002</nova:name>
Nov 14 06:33:44 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:33:41</nova:creationTime>
Nov 14 06:33:44 user nova-compute[75354]:       <nova:flavor name="m1.small">
Nov 14 06:33:44 user nova-compute[75354]:         <nova:memory>2048</nova:memory>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:disk>20</nova:disk>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:33:44 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:33:44 user nova-compute[75354]:       <nova:owner>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:user uuid="7678e8df1dc94bb999962858edc7ec5f">tempest-ServerActionsTestOtherB-766403064-project-member</nova:user>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:project uuid="a152b44325b84778b31a79b9faf1b443">tempest-ServerActionsTestOtherB-766403064</nova:project>
Nov 14 06:33:44 user nova-compute[75354]:       </nova:owner>
Nov 14 06:33:44 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:33:44 user nova-compute[75354]:       <nova:ports>
Nov 14 06:33:44 user nova-compute[75354]:         <nova:port uuid="307913af-8833-4c78-8600-a43bbc913f5a">
Nov 14 06:33:44 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 06:33:44 user nova-compute[75354]:         </nova:port>
Nov 14 06:33:44 user nova-compute[75354]:       </nova:ports>
Nov 14 06:33:44 user nova-compute[75354]:     </nova:instance>
Nov 14 06:33:44 user nova-compute[75354]:   </metadata>
Nov 14 06:33:44 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:33:44 user nova-compute[75354]:     <system>
Nov 14 06:33:44 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:33:44 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:33:44 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:33:44 user nova-compute[75354]:       <entry name="serial">787b732d-c4cc-4cf1-8069-6a8d0458b3b9</entry>
Nov 14 06:33:44 user nova-compute[75354]:       <entry name="uuid">787b732d-c4cc-4cf1-8069-6a8d0458b3b9</entry>
Nov 14 06:33:44 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:33:44 user nova-compute[75354]:     </system>
Nov 14 06:33:44 user nova-compute[75354]:   </sysinfo>
Nov 14 06:33:44 user nova-compute[75354]:   <os>
Nov 14 06:33:44 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:33:44 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:33:44 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:33:44 user nova-compute[75354]:   </os>
Nov 14 06:33:44 user nova-compute[75354]:   <features>
Nov 14 06:33:44 user nova-compute[75354]:     <acpi/>
Nov 14 06:33:44 user nova-compute[75354]:     <apic/>
Nov 14 06:33:44 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:33:44 user nova-compute[75354]:   </features>
Nov 14 06:33:44 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:33:44 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:33:44 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:33:44 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:33:44 user nova-compute[75354]:   </clock>
Nov 14 06:33:44 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:33:44 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:33:44 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:33:44 user nova-compute[75354]:   </cpu>
Nov 14 06:33:44 user nova-compute[75354]:   <devices>
Nov 14 06:33:44 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:33:44 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:33:44 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk"/>
Nov 14 06:33:44 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:33:44 user nova-compute[75354]:     </disk>
Nov 14 06:33:44 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:33:44 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:33:44 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 06:33:44 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:33:44 user nova-compute[75354]:       <serial>6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf</serial>
Nov 14 06:33:44 user nova-compute[75354]:     </disk>
Nov 14 06:33:44 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:33:44 user nova-compute[75354]:       <mac address="fa:16:3e:f8:4e:57"/>
Nov 14 06:33:44 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:44 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:33:44 user nova-compute[75354]:       <target dev="tap307913af-88"/>
Nov 14 06:33:44 user nova-compute[75354]:     </interface>
Nov 14 06:33:44 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:33:44 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/console.log" append="off"/>
Nov 14 06:33:44 user nova-compute[75354]:     </serial>
Nov 14 06:33:44 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:33:44 user nova-compute[75354]:     <video>
Nov 14 06:33:44 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:44 user nova-compute[75354]:     </video>
Nov 14 06:33:44 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:33:44 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:33:44 user nova-compute[75354]:     </rng>
Nov 14 06:33:44 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:33:44 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:33:44 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:33:44 user nova-compute[75354]:     </memballoon>
Nov 14 06:33:44 user nova-compute[75354]:   </devices>
Nov 14 06:33:44 user nova-compute[75354]: </domain>
Nov 14 06:33:44 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-660529357-network", "vif_mac": "fa:16:3e:f8:4e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG os_vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29ed5203-f502-5910-8fb8-178af698d47e', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307913af-88, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap307913af-88, col_values=(('qos', UUID('ab327a33-6172-4d75-afe4-597da823b478')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap307913af-88, col_values=(('external_ids', {'iface-id': '307913af-8833-4c78-8600-a43bbc913f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4e:57', 'vm-uuid': '787b732d-c4cc-4cf1-8069-6a8d0458b3b9'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: INFO os_vif [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88')
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] No VIF found with MAC fa:16:3e:f8:4e:57, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-19491606-d251-4b22-ad42-1d0131a2d374 req-0dc17d0b-0909-4075-afbd-8980f3f57524 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-19491606-d251-4b22-ad42-1d0131a2d374 req-0dc17d0b-0909-4075-afbd-8980f3f57524 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-19491606-d251-4b22-ad42-1d0131a2d374 req-0dc17d0b-0909-4075-afbd-8980f3f57524 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-19491606-d251-4b22-ad42-1d0131a2d374 req-0dc17d0b-0909-4075-afbd-8980f3f57524 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-19491606-d251-4b22-ad42-1d0131a2d374 req-0dc17d0b-0909-4075-afbd-8980f3f57524 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:44 user nova-compute[75354]: WARNING nova.compute.manager [req-19491606-d251-4b22-ad42-1d0131a2d374 req-0dc17d0b-0909-4075-afbd-8980f3f57524 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state None.
Nov 14 06:33:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Successfully created port: 596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Successfully updated port: 25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-changed-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Refreshing instance network info cache due to event network-changed-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance network_info: |[{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Refreshing network info cache for port 25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Start _get_guest_xml network_info=[{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:33:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1459502704',display_name='tempest-ServerRescueNegativeTestJSON-server-1459502704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1459502704',id=13,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-0i4xxzk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:42Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=4f8c2f10-c9dc-4094-832a-bd5ea80160a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:33:46 user nova-compute[75354]:   <uuid>4f8c2f10-c9dc-4094-832a-bd5ea80160a3</uuid>
Nov 14 06:33:46 user nova-compute[75354]:   <name>instance-0000000d</name>
Nov 14 06:33:46 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:33:46 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:33:46 user nova-compute[75354]:   <metadata>
Nov 14 06:33:46 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:33:46 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:33:46 user nova-compute[75354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1459502704</nova:name>
Nov 14 06:33:46 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:33:46</nova:creationTime>
Nov 14 06:33:46 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:33:46 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:33:46 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:33:46 user nova-compute[75354]:       <nova:owner>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:user uuid="7f141a1ef1b44b34b09a8f2f88d5af17">tempest-ServerRescueNegativeTestJSON-2059994566-project-member</nova:user>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:project uuid="601a7175bd194f79b4ae31d34f724de4">tempest-ServerRescueNegativeTestJSON-2059994566</nova:project>
Nov 14 06:33:46 user nova-compute[75354]:       </nova:owner>
Nov 14 06:33:46 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:33:46 user nova-compute[75354]:       <nova:ports>
Nov 14 06:33:46 user nova-compute[75354]:         <nova:port uuid="25cb9c60-0a6b-44e6-8ac3-56b1daa1608b">
Nov 14 06:33:46 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 06:33:46 user nova-compute[75354]:         </nova:port>
Nov 14 06:33:46 user nova-compute[75354]:       </nova:ports>
Nov 14 06:33:46 user nova-compute[75354]:     </nova:instance>
Nov 14 06:33:46 user nova-compute[75354]:   </metadata>
Nov 14 06:33:46 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:33:46 user nova-compute[75354]:     <system>
Nov 14 06:33:46 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:33:46 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:33:46 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:33:46 user nova-compute[75354]:       <entry name="serial">4f8c2f10-c9dc-4094-832a-bd5ea80160a3</entry>
Nov 14 06:33:46 user nova-compute[75354]:       <entry name="uuid">4f8c2f10-c9dc-4094-832a-bd5ea80160a3</entry>
Nov 14 06:33:46 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:33:46 user nova-compute[75354]:     </system>
Nov 14 06:33:46 user nova-compute[75354]:   </sysinfo>
Nov 14 06:33:46 user nova-compute[75354]:   <os>
Nov 14 06:33:46 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:33:46 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:33:46 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:33:46 user nova-compute[75354]:   </os>
Nov 14 06:33:46 user nova-compute[75354]:   <features>
Nov 14 06:33:46 user nova-compute[75354]:     <acpi/>
Nov 14 06:33:46 user nova-compute[75354]:     <apic/>
Nov 14 06:33:46 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:33:46 user nova-compute[75354]:   </features>
Nov 14 06:33:46 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:33:46 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:33:46 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:33:46 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:33:46 user nova-compute[75354]:   </clock>
Nov 14 06:33:46 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:33:46 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:33:46 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:33:46 user nova-compute[75354]:   </cpu>
Nov 14 06:33:46 user nova-compute[75354]:   <devices>
Nov 14 06:33:46 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:33:46 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:33:46 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk"/>
Nov 14 06:33:46 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:33:46 user nova-compute[75354]:     </disk>
Nov 14 06:33:46 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:33:46 user nova-compute[75354]:       <mac address="fa:16:3e:da:e9:1b"/>
Nov 14 06:33:46 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:46 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:33:46 user nova-compute[75354]:       <target dev="tap25cb9c60-0a"/>
Nov 14 06:33:46 user nova-compute[75354]:     </interface>
Nov 14 06:33:46 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:33:46 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/console.log" append="off"/>
Nov 14 06:33:46 user nova-compute[75354]:     </serial>
Nov 14 06:33:46 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:33:46 user nova-compute[75354]:     <video>
Nov 14 06:33:46 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:46 user nova-compute[75354]:     </video>
Nov 14 06:33:46 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:33:46 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:33:46 user nova-compute[75354]:     </rng>
Nov 14 06:33:46 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:33:46 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:33:46 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:33:46 user nova-compute[75354]:     </memballoon>
Nov 14 06:33:46 user nova-compute[75354]:   </devices>
Nov 14 06:33:46 user nova-compute[75354]: </domain>
Nov 14 06:33:46 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1459502704',display_name='tempest-ServerRescueNegativeTestJSON-server-1459502704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1459502704',id=13,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-0i4xxzk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:42Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=4f8c2f10-c9dc-4094-832a-bd5ea80160a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG os_vif [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ddb2770-404d-5c62-9c48-73c85704b52f', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25cb9c60-0a, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25cb9c60-0a, col_values=(('qos', UUID('7204a5f6-7545-41db-91f1-dca08d307118')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25cb9c60-0a, col_values=(('external_ids', {'iface-id': '25cb9c60-0a6b-44e6-8ac3-56b1daa1608b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:e9:1b', 'vm-uuid': '4f8c2f10-c9dc-4094-832a-bd5ea80160a3'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: INFO os_vif [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a')
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:da:e9:1b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Successfully updated port: 596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:46 user nova-compute[75354]: WARNING nova.compute.manager [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state resize_finish.
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:46 user nova-compute[75354]: WARNING nova.compute.manager [req-f4e925ed-0a58-46f8-b9a2-8cbe1dc03211 req-77488f7b-f6dd-4337-829b-5678a1bba489 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state resize_finish.
Nov 14 06:33:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updated VIF entry in instance network info cache for port 25cb9c60-0a6b-44e6-8ac3-56b1daa1608b. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d00d0572-b02d-4bff-b6a0-9c631f63b70e req-c2ffae39-2d7b-4133-9804-46521bcd7775 service nova] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance network_info: |[{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Start _get_guest_xml network_info=[{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:33:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1517792480',display_name='tempest-ServerRescueNegativeTestJSON-server-1517792480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1517792480',id=14,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-hbtz4cbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:43Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=dce2abf5-a489-4d92-8a91-b3f436c53a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'pci_devices' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:33:47 user nova-compute[75354]:   <uuid>dce2abf5-a489-4d92-8a91-b3f436c53a50</uuid>
Nov 14 06:33:47 user nova-compute[75354]:   <name>instance-0000000e</name>
Nov 14 06:33:47 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:33:47 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:33:47 user nova-compute[75354]:   <metadata>
Nov 14 06:33:47 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:33:47 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:33:47 user nova-compute[75354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1517792480</nova:name>
Nov 14 06:33:47 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:33:47</nova:creationTime>
Nov 14 06:33:47 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:33:47 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:33:47 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:33:47 user nova-compute[75354]:       <nova:owner>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:user uuid="7f141a1ef1b44b34b09a8f2f88d5af17">tempest-ServerRescueNegativeTestJSON-2059994566-project-member</nova:user>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:project uuid="601a7175bd194f79b4ae31d34f724de4">tempest-ServerRescueNegativeTestJSON-2059994566</nova:project>
Nov 14 06:33:47 user nova-compute[75354]:       </nova:owner>
Nov 14 06:33:47 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:33:47 user nova-compute[75354]:       <nova:ports>
Nov 14 06:33:47 user nova-compute[75354]:         <nova:port uuid="596b67d5-4969-419f-a281-4b5722e48708">
Nov 14 06:33:47 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:33:47 user nova-compute[75354]:         </nova:port>
Nov 14 06:33:47 user nova-compute[75354]:       </nova:ports>
Nov 14 06:33:47 user nova-compute[75354]:     </nova:instance>
Nov 14 06:33:47 user nova-compute[75354]:   </metadata>
Nov 14 06:33:47 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:33:47 user nova-compute[75354]:     <system>
Nov 14 06:33:47 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:33:47 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:33:47 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:33:47 user nova-compute[75354]:       <entry name="serial">dce2abf5-a489-4d92-8a91-b3f436c53a50</entry>
Nov 14 06:33:47 user nova-compute[75354]:       <entry name="uuid">dce2abf5-a489-4d92-8a91-b3f436c53a50</entry>
Nov 14 06:33:47 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:33:47 user nova-compute[75354]:     </system>
Nov 14 06:33:47 user nova-compute[75354]:   </sysinfo>
Nov 14 06:33:47 user nova-compute[75354]:   <os>
Nov 14 06:33:47 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:33:47 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:33:47 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:33:47 user nova-compute[75354]:   </os>
Nov 14 06:33:47 user nova-compute[75354]:   <features>
Nov 14 06:33:47 user nova-compute[75354]:     <acpi/>
Nov 14 06:33:47 user nova-compute[75354]:     <apic/>
Nov 14 06:33:47 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:33:47 user nova-compute[75354]:   </features>
Nov 14 06:33:47 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:33:47 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:33:47 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:33:47 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:33:47 user nova-compute[75354]:   </clock>
Nov 14 06:33:47 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:33:47 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:33:47 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:33:47 user nova-compute[75354]:   </cpu>
Nov 14 06:33:47 user nova-compute[75354]:   <devices>
Nov 14 06:33:47 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:33:47 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:33:47 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk"/>
Nov 14 06:33:47 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:33:47 user nova-compute[75354]:     </disk>
Nov 14 06:33:47 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:33:47 user nova-compute[75354]:       <mac address="fa:16:3e:9d:d8:e9"/>
Nov 14 06:33:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:47 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:33:47 user nova-compute[75354]:       <target dev="tap596b67d5-49"/>
Nov 14 06:33:47 user nova-compute[75354]:     </interface>
Nov 14 06:33:47 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:33:47 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/console.log" append="off"/>
Nov 14 06:33:47 user nova-compute[75354]:     </serial>
Nov 14 06:33:47 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:33:47 user nova-compute[75354]:     <video>
Nov 14 06:33:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:47 user nova-compute[75354]:     </video>
Nov 14 06:33:47 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:33:47 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:33:47 user nova-compute[75354]:     </rng>
Nov 14 06:33:47 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:33:47 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:33:47 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:33:47 user nova-compute[75354]:     </memballoon>
Nov 14 06:33:47 user nova-compute[75354]:   </devices>
Nov 14 06:33:47 user nova-compute[75354]: </domain>
Nov 14 06:33:47 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1517792480',display_name='tempest-ServerRescueNegativeTestJSON-server-1517792480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1517792480',id=14,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-hbtz4cbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:43Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=dce2abf5-a489-4d92-8a91-b3f436c53a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG os_vif [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14291570-1640-5d89-9cac-9ea22b85c716', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap596b67d5-49, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap596b67d5-49, col_values=(('qos', UUID('b9d88a5b-6ed7-40fd-b738-9f31867efe64')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap596b67d5-49, col_values=(('external_ids', {'iface-id': '596b67d5-4969-419f-a281-4b5722e48708', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:d8:e9', 'vm-uuid': 'dce2abf5-a489-4d92-8a91-b3f436c53a50'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: INFO os_vif [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49')
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:9d:d8:e9, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-changed-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Refreshing instance network info cache due to event network-changed-596b67d5-4969-419f-a281-4b5722e48708. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] Acquiring lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] Acquired lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Refreshing network info cache for port 596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updated VIF entry in instance network info cache for port 596b67d5-4969-419f-a281-4b5722e48708. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb41f859-91fb-43da-b869-2825696bd752 req-5eec91e6-aa5a-4299-b7b1-a90a5f4580af service nova] Releasing lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:33:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance running successfully.
Nov 14 06:33:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Failed to set time: agent not configured {{(pid=75354) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-05b666e0-a4ca-4b52-aa7a-dac5c09cd9a3 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] finish_migration finished successfully. {{(pid=75354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-d61723fc-27fb-48f3-9668-a77d01f41186 req-ea5e936f-c9d9-4d2d-915a-84037d9b5ab5 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d61723fc-27fb-48f3-9668-a77d01f41186 req-ea5e936f-c9d9-4d2d-915a-84037d9b5ab5 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d61723fc-27fb-48f3-9668-a77d01f41186 req-ea5e936f-c9d9-4d2d-915a-84037d9b5ab5 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d61723fc-27fb-48f3-9668-a77d01f41186 req-ea5e936f-c9d9-4d2d-915a-84037d9b5ab5 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-d61723fc-27fb-48f3-9668-a77d01f41186 req-ea5e936f-c9d9-4d2d-915a-84037d9b5ab5 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:48 user nova-compute[75354]: WARNING nova.compute.manager [req-d61723fc-27fb-48f3-9668-a77d01f41186 req-ea5e936f-c9d9-4d2d-915a-84037d9b5ab5 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state building and task_state spawning.
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-813085dc-90c3-4b33-a4a2-f9ca7d53e711 req-d732e6dd-d078-433f-8abe-633b8f7b2237 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-813085dc-90c3-4b33-a4a2-f9ca7d53e711 req-d732e6dd-d078-433f-8abe-633b8f7b2237 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-813085dc-90c3-4b33-a4a2-f9ca7d53e711 req-d732e6dd-d078-433f-8abe-633b8f7b2237 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-813085dc-90c3-4b33-a4a2-f9ca7d53e711 req-d732e6dd-d078-433f-8abe-633b8f7b2237 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-813085dc-90c3-4b33-a4a2-f9ca7d53e711 req-d732e6dd-d078-433f-8abe-633b8f7b2237 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:50 user nova-compute[75354]: WARNING nova.compute.manager [req-813085dc-90c3-4b33-a4a2-f9ca7d53e711 req-d732e6dd-d078-433f-8abe-633b8f7b2237 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state building and task_state spawning.
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-e26d9c72-58c9-4ad8-86fa-62f1c9ded171 req-6e16b2a6-cea5-4ca8-a582-95160bd3de84 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e26d9c72-58c9-4ad8-86fa-62f1c9ded171 req-6e16b2a6-cea5-4ca8-a582-95160bd3de84 service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e26d9c72-58c9-4ad8-86fa-62f1c9ded171 req-6e16b2a6-cea5-4ca8-a582-95160bd3de84 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e26d9c72-58c9-4ad8-86fa-62f1c9ded171 req-6e16b2a6-cea5-4ca8-a582-95160bd3de84 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-e26d9c72-58c9-4ad8-86fa-62f1c9ded171 req-6e16b2a6-cea5-4ca8-a582-95160bd3de84 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:51 user nova-compute[75354]: WARNING nova.compute.manager [req-e26d9c72-58c9-4ad8-86fa-62f1c9ded171 req-6e16b2a6-cea5-4ca8-a582-95160bd3de84 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state building and task_state spawning.
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:33:51 user nova-compute[75354]: INFO nova.compute.claims [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Claim successful on node user
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:51 user nova-compute[75354]: INFO nova.compute.manager [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Terminating instance
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:33:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance spawned successfully.
Nov 14 06:33:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Took 10.16 seconds to spawn the instance on the hypervisor.
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.policy [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07a6a0821bc7469aa98ea385fce07d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4c745886794abd990a6f71547f67f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance spawned successfully.
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Instance destroyed successfully.
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lazy-loading 'resources' on Instance uuid 93429017-a737-45d4-965b-d7369a440bf8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-170243607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2097679557',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+U3sLOre+F5aoiCDKzHyv9ZTfTl812MaliLoYlPWTQ62vXFOp6v+jH/QM0j4JEuXeCOVF2NnI+RHNMb3Q/SAd3L0i/qEX0Ssw/kKVMRBXrQMIpN0cAzNOwCP4hnqSaA==',key_name='tempest-keypair-1519457139',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e074784c3da44c8b4c2c97972f1d94b',ramdisk_id='',reservation_id='r-brr8bk9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2126097574',owner_user_name='tempest-ServerActionsV293TestJSON-2126097574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='332071a34d4c44ed8529fe3431ead3c1',uuid=93429017-a737-45d4-965b-d7369a440bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converting VIF {"id": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "address": "fa:16:3e:b7:e1:db", "network": {"id": "e07f5725-2c83-44f7-85de-f6933acf6b51", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-78029908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e074784c3da44c8b4c2c97972f1d94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906df1dc-5f", "ovs_interfaceid": "906df1dc-5f74-42b1-b5bf-97d24850db6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_vif [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Creating image(s)
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "/opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "/opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap906df1dc-5f, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.compute.manager [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Took 11.27 seconds to build instance.
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bff786e2-a30c-4d3f-8c09-1b8c3518237d) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Took 9.23 seconds to spawn the instance on the hypervisor.
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:52 user nova-compute[75354]: INFO os_vif [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:db,bridge_name='br-int',has_traffic_filtering=True,id=906df1dc-5f74-42b1-b5bf-97d24850db6f,network=Network(e07f5725-2c83-44f7-85de-f6933acf6b51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap906df1dc-5f')
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZCALYJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:33:52 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36455557-9349-4bda-bdca-a23e984125a1 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.495s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[447eebc8-8352-4160-af7a-2c6e37518e27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:33:52 user nova-compute[75354]: No targets found.
Nov 14 06:33:52 user nova-compute[75354]: iSNS:
Nov 14 06:33:52 user nova-compute[75354]: No targets found.
Nov 14 06:33:52 user nova-compute[75354]: STATIC:
Nov 14 06:33:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:33:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:33:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1
Nov 14 06:33:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:33:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:33:52 user nova-compute[75354]: FIRMWARE:
Nov 14 06:33:52 user nova-compute[75354]: No targets found.
Nov 14 06:33:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:33:52 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:33:52 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962d53b-8154-473a-a9a3-5ad0f1c0d7c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3581ad-a6ac-4b41-8f21-1606d13004a7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:52 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:52 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 (non-flash)
Nov 14 06:33:52 user nova-compute[75354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:33:52 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:33:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074477640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1'): ({'sdi'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Removing single pathed devices sdi {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613aa3c-1db9-410b-9d90-0ae8f74270d3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.compute.manager [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Took 10.51 seconds to build instance.
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.255s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659997f-ed0d-4a66-a37a-d52fb5873286]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Flushing IO for device /dev/sdi {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c343f1e1-54b3-410f-8c76-b589aba40600 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.743s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a2e42-b83e-4f30-9649-39c5c7b9bfa8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d533be18-aade-461e-8bee-251e5e6f3fdc]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] SCSI volumes sdi have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b810e1d1', '/dev/disk/by-id/scsi-26461613033323332', '/dev/disk/by-id/scsi-1SCST_BIOb810e1d1-daa03232365a13d1') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 06:33:52 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b810e1d1
Nov 14 06:33:52 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26461613033323332
Nov 14 06:33:52 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb810e1d1-daa03232365a13d1
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec68b4f-0d0d-4929-874c-70ca1f818bb4]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[971641ea-637c-4c84-93a8-ff72984b0240]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.217s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd09bc3-37f3-4894-8f55-bd49f12f57a9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260]
Nov 14 06:33:52 user nova-compute[75354]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1, portal: 172.16.0.220,3260] successful.
Nov 14 06:33:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk 1073741824" returned: 0 in 0.071s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf2c5b-e1af-476c-a946-02e0d7bb580c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.536s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] <== disconnect_volume: return (539ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:33:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Deleting instance files /opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8_del
Nov 14 06:33:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Deletion of /opt/stack/data/nova/instances/93429017-a737-45d4-965b-d7369a440bf8_del complete
Nov 14 06:33:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Successfully created port: 1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:33:53 user nova-compute[75354]: INFO nova.compute.manager [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Took 1.63 seconds to destroy the instance on the hypervisor.
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.255s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:53 user nova-compute[75354]: WARNING nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state active and task_state None.
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-unplugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-unplugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-unplugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Acquiring lock "93429017-a737-45d4-965b-d7369a440bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] Lock "93429017-a737-45d4-965b-d7369a440bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] No waiting events found dispatching network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:53 user nova-compute[75354]: WARNING nova.compute.manager [req-0c461620-add2-48eb-8e7f-cd76b90cf4e5 req-9650b260-5b26-4449-a4b2-433040290c0a service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received unexpected event network-vif-plugged-906df1dc-5f74-42b1-b5bf-97d24850db6f for instance with vm_state active and task_state deleting.
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Ensure instance console log exists: /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Successfully updated port: 1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquired lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:55 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Took 2.01 seconds to deallocate network for instance.
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-changed-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Refreshing instance network info cache due to event network-changed-1908e79c-265a-4dfd-91ad-ab4e87986ed9. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] Acquiring lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updating instance_info_cache with network_info: [{"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Releasing lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Instance network_info: |[{"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] Acquired lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Refreshing network info cache for port 1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Start _get_guest_xml network_info=[{"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:33:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1989477807',display_name='tempest-TestVolumeSwap-server-1989477807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1989477807',id=15,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9+8pnBmxDWQM7OSxosbLVVB/Ix5O7YFVt+A2DgcJO8rJO1w/Eqv+LFEz5a4Vap5s1e08iZbNjjqNLHd/AJCtm5saAU2Z9Bg4u0xYWqtL5NP4+KR8ONB4wHuitvngnfgA==',key_name='tempest-keypair-192472840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4c745886794abd990a6f71547f67f0',ramdisk_id='',reservation_id='r-eumf4qp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1437105103',owner_user_name='tempest-TestVolumeSwap-1437105103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07a6a0821bc7469aa98ea385fce07d6f',uuid=9ad47fd2-5e38-4ef6-a007-374bb9a21df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Converting VIF {"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:33:55 user nova-compute[75354]:   <uuid>9ad47fd2-5e38-4ef6-a007-374bb9a21df7</uuid>
Nov 14 06:33:55 user nova-compute[75354]:   <name>instance-0000000f</name>
Nov 14 06:33:55 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:33:55 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:33:55 user nova-compute[75354]:   <metadata>
Nov 14 06:33:55 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:33:55 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:33:55 user nova-compute[75354]:       <nova:name>tempest-TestVolumeSwap-server-1989477807</nova:name>
Nov 14 06:33:55 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:33:55</nova:creationTime>
Nov 14 06:33:55 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:33:55 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:33:55 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:33:55 user nova-compute[75354]:       <nova:owner>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:user uuid="07a6a0821bc7469aa98ea385fce07d6f">tempest-TestVolumeSwap-1437105103-project-member</nova:user>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:project uuid="3c4c745886794abd990a6f71547f67f0">tempest-TestVolumeSwap-1437105103</nova:project>
Nov 14 06:33:55 user nova-compute[75354]:       </nova:owner>
Nov 14 06:33:55 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:33:55 user nova-compute[75354]:       <nova:ports>
Nov 14 06:33:55 user nova-compute[75354]:         <nova:port uuid="1908e79c-265a-4dfd-91ad-ab4e87986ed9">
Nov 14 06:33:55 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 06:33:55 user nova-compute[75354]:         </nova:port>
Nov 14 06:33:55 user nova-compute[75354]:       </nova:ports>
Nov 14 06:33:55 user nova-compute[75354]:     </nova:instance>
Nov 14 06:33:55 user nova-compute[75354]:   </metadata>
Nov 14 06:33:55 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:33:55 user nova-compute[75354]:     <system>
Nov 14 06:33:55 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:33:55 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:33:55 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:33:55 user nova-compute[75354]:       <entry name="serial">9ad47fd2-5e38-4ef6-a007-374bb9a21df7</entry>
Nov 14 06:33:55 user nova-compute[75354]:       <entry name="uuid">9ad47fd2-5e38-4ef6-a007-374bb9a21df7</entry>
Nov 14 06:33:55 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:33:55 user nova-compute[75354]:     </system>
Nov 14 06:33:55 user nova-compute[75354]:   </sysinfo>
Nov 14 06:33:55 user nova-compute[75354]:   <os>
Nov 14 06:33:55 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:33:55 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:33:55 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:33:55 user nova-compute[75354]:   </os>
Nov 14 06:33:55 user nova-compute[75354]:   <features>
Nov 14 06:33:55 user nova-compute[75354]:     <acpi/>
Nov 14 06:33:55 user nova-compute[75354]:     <apic/>
Nov 14 06:33:55 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:33:55 user nova-compute[75354]:   </features>
Nov 14 06:33:55 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:33:55 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:33:55 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:33:55 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:33:55 user nova-compute[75354]:   </clock>
Nov 14 06:33:55 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:33:55 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:33:55 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:33:55 user nova-compute[75354]:   </cpu>
Nov 14 06:33:55 user nova-compute[75354]:   <devices>
Nov 14 06:33:55 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:33:55 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:33:55 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk"/>
Nov 14 06:33:55 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:33:55 user nova-compute[75354]:     </disk>
Nov 14 06:33:55 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:33:55 user nova-compute[75354]:       <mac address="fa:16:3e:f2:f2:09"/>
Nov 14 06:33:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:55 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:33:55 user nova-compute[75354]:       <target dev="tap1908e79c-26"/>
Nov 14 06:33:55 user nova-compute[75354]:     </interface>
Nov 14 06:33:55 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:33:55 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/console.log" append="off"/>
Nov 14 06:33:55 user nova-compute[75354]:     </serial>
Nov 14 06:33:55 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:33:55 user nova-compute[75354]:     <video>
Nov 14 06:33:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:33:55 user nova-compute[75354]:     </video>
Nov 14 06:33:55 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:33:55 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:33:55 user nova-compute[75354]:     </rng>
Nov 14 06:33:55 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:33:55 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:33:55 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:33:55 user nova-compute[75354]:     </memballoon>
Nov 14 06:33:55 user nova-compute[75354]:   </devices>
Nov 14 06:33:55 user nova-compute[75354]: </domain>
Nov 14 06:33:55 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1989477807',display_name='tempest-TestVolumeSwap-server-1989477807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1989477807',id=15,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9+8pnBmxDWQM7OSxosbLVVB/Ix5O7YFVt+A2DgcJO8rJO1w/Eqv+LFEz5a4Vap5s1e08iZbNjjqNLHd/AJCtm5saAU2Z9Bg4u0xYWqtL5NP4+KR8ONB4wHuitvngnfgA==',key_name='tempest-keypair-192472840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4c745886794abd990a6f71547f67f0',ramdisk_id='',reservation_id='r-eumf4qp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1437105103',owner_user_name='tempest-TestVolumeSwap-1437105103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07a6a0821bc7469aa98ea385fce07d6f',uuid=9ad47fd2-5e38-4ef6-a007-374bb9a21df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Converting VIF {"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG os_vif [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8706454-460f-54c3-9032-ffafdab325c2', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1908e79c-26, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1908e79c-26, col_values=(('qos', UUID('e3955016-fb3e-4975-a43b-3a610feddd0a')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1908e79c-26, col_values=(('external_ids', {'iface-id': '1908e79c-265a-4dfd-91ad-ab4e87986ed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:f2:09', 'vm-uuid': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:55 user nova-compute[75354]: INFO os_vif [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26')
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] No VIF found with MAC fa:16:3e:f2:f2:09, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:33:55 user nova-compute[75354]: INFO nova.compute.manager [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Took 0.86 seconds to detach 1 volumes for instance.
Nov 14 06:33:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Deleting volume: e0d254a3-d3f4-4fd0-94ed-ad18a81c1aa1 {{(pid=75354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updated VIF entry in instance network info cache for port 1908e79c-265a-4dfd-91ad-ab4e87986ed9. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updating instance_info_cache with network_info: [{"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] Releasing lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-a62586d0-cfc5-44ca-9c1f-eb26d587bae6 req-2527c04d-9ebd-465f-8439-93f863cde6b3 service nova] [instance: 93429017-a737-45d4-965b-d7369a440bf8] Received event network-vif-deleted-906df1dc-5f74-42b1-b5bf-97d24850db6f {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:33:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:56 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Deleted allocations for instance 93429017-a737-45d4-965b-d7369a440bf8
Nov 14 06:33:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c5dcee8c-a620-4228-a873-7addf28e54fc tempest-ServerActionsV293TestJSON-2126097574 tempest-ServerActionsV293TestJSON-2126097574-project-member] Lock "93429017-a737-45d4-965b-d7369a440bf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.302s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-2479484c-3c5c-470d-8003-39e83c06bf5f req-844e75fc-2941-4c75-8f59-0a42dced3741 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2479484c-3c5c-470d-8003-39e83c06bf5f req-844e75fc-2941-4c75-8f59-0a42dced3741 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2479484c-3c5c-470d-8003-39e83c06bf5f req-844e75fc-2941-4c75-8f59-0a42dced3741 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2479484c-3c5c-470d-8003-39e83c06bf5f req-844e75fc-2941-4c75-8f59-0a42dced3741 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-2479484c-3c5c-470d-8003-39e83c06bf5f req-844e75fc-2941-4c75-8f59-0a42dced3741 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:57 user nova-compute[75354]: WARNING nova.compute.manager [req-2479484c-3c5c-470d-8003-39e83c06bf5f req-844e75fc-2941-4c75-8f59-0a42dced3741 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state building and task_state spawning.
Nov 14 06:33:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-db4d1cb3-19b5-48ae-8101-32519d85a83f req-da2996c8-489c-463d-a678-4f32adf06de7 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-db4d1cb3-19b5-48ae-8101-32519d85a83f req-da2996c8-489c-463d-a678-4f32adf06de7 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-db4d1cb3-19b5-48ae-8101-32519d85a83f req-da2996c8-489c-463d-a678-4f32adf06de7 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-db4d1cb3-19b5-48ae-8101-32519d85a83f req-da2996c8-489c-463d-a678-4f32adf06de7 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-db4d1cb3-19b5-48ae-8101-32519d85a83f req-da2996c8-489c-463d-a678-4f32adf06de7 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:33:59 user nova-compute[75354]: WARNING nova.compute.manager [req-db4d1cb3-19b5-48ae-8101-32519d85a83f req-da2996c8-489c-463d-a678-4f32adf06de7 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state building and task_state spawning.
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:33:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Instance spawned successfully.
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:33:59 user nova-compute[75354]: INFO nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Took 7.48 seconds to spawn the instance on the hypervisor.
Nov 14 06:33:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:33:59 user nova-compute[75354]: INFO nova.compute.manager [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Took 8.65 seconds to build instance.
Nov 14 06:34:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f0e74741-6472-41f8-a987-482c265e197d tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.983s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:34:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:34:25 user nova-compute[75354]: INFO nova.compute.claims [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Claim successful on node user
Nov 14 06:34:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.network.neutron [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.policy [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfc31b05a2848128a837f170ac63b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0fdd525e8a49aeac22892962d8b14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:34:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:34:26 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Creating image(s)
Nov 14 06:34:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.network.neutron [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Successfully created port: 96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk 1073741824" returned: 0 in 0.056s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Cannot resize image /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Ensure instance console log exists: /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.network.neutron [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Successfully updated port: 96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.network.neutron [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-changed-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Refreshing instance network info cache due to event network-changed-96458fbf-4165-4a69-92eb-c806810ef7e8. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] Acquiring lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG nova.network.neutron [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updating instance_info_cache with network_info: [{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Instance network_info: |[{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] Acquired lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.neutron [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Refreshing network info cache for port 96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Start _get_guest_xml network_info=[{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:34:28 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:34:28 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771886086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771886086',id=16,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-sgebyxq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:34:27Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=2b2f22af-1a41-4747-9a16-561e260d5f63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.objects.instance [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b2f22af-1a41-4747-9a16-561e260d5f63 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:34:28 user nova-compute[75354]:   <uuid>2b2f22af-1a41-4747-9a16-561e260d5f63</uuid>
Nov 14 06:34:28 user nova-compute[75354]:   <name>instance-00000010</name>
Nov 14 06:34:28 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:34:28 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:34:28 user nova-compute[75354]:   <metadata>
Nov 14 06:34:28 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:34:28 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:34:28 user nova-compute[75354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-771886086</nova:name>
Nov 14 06:34:28 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:34:28</nova:creationTime>
Nov 14 06:34:28 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:34:28 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:34:28 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:34:28 user nova-compute[75354]:       <nova:owner>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:user uuid="2dfc31b05a2848128a837f170ac63b93">tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member</nova:user>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:project uuid="7e0fdd525e8a49aeac22892962d8b14e">tempest-ServerBootFromVolumeStableRescueTest-1883221150</nova:project>
Nov 14 06:34:28 user nova-compute[75354]:       </nova:owner>
Nov 14 06:34:28 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:34:28 user nova-compute[75354]:       <nova:ports>
Nov 14 06:34:28 user nova-compute[75354]:         <nova:port uuid="96458fbf-4165-4a69-92eb-c806810ef7e8">
Nov 14 06:34:28 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 06:34:28 user nova-compute[75354]:         </nova:port>
Nov 14 06:34:28 user nova-compute[75354]:       </nova:ports>
Nov 14 06:34:28 user nova-compute[75354]:     </nova:instance>
Nov 14 06:34:28 user nova-compute[75354]:   </metadata>
Nov 14 06:34:28 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:34:28 user nova-compute[75354]:     <system>
Nov 14 06:34:28 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:34:28 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:34:28 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:34:28 user nova-compute[75354]:       <entry name="serial">2b2f22af-1a41-4747-9a16-561e260d5f63</entry>
Nov 14 06:34:28 user nova-compute[75354]:       <entry name="uuid">2b2f22af-1a41-4747-9a16-561e260d5f63</entry>
Nov 14 06:34:28 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:34:28 user nova-compute[75354]:     </system>
Nov 14 06:34:28 user nova-compute[75354]:   </sysinfo>
Nov 14 06:34:28 user nova-compute[75354]:   <os>
Nov 14 06:34:28 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:34:28 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:34:28 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:34:28 user nova-compute[75354]:   </os>
Nov 14 06:34:28 user nova-compute[75354]:   <features>
Nov 14 06:34:28 user nova-compute[75354]:     <acpi/>
Nov 14 06:34:28 user nova-compute[75354]:     <apic/>
Nov 14 06:34:28 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:34:28 user nova-compute[75354]:   </features>
Nov 14 06:34:28 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:34:28 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:34:28 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:34:28 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:34:28 user nova-compute[75354]:   </clock>
Nov 14 06:34:28 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:34:28 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:34:28 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:34:28 user nova-compute[75354]:   </cpu>
Nov 14 06:34:28 user nova-compute[75354]:   <devices>
Nov 14 06:34:28 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:34:28 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:34:28 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk"/>
Nov 14 06:34:28 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:34:28 user nova-compute[75354]:     </disk>
Nov 14 06:34:28 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:34:28 user nova-compute[75354]:       <mac address="fa:16:3e:d9:66:91"/>
Nov 14 06:34:28 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:34:28 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:34:28 user nova-compute[75354]:       <target dev="tap96458fbf-41"/>
Nov 14 06:34:28 user nova-compute[75354]:     </interface>
Nov 14 06:34:28 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:34:28 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/console.log" append="off"/>
Nov 14 06:34:28 user nova-compute[75354]:     </serial>
Nov 14 06:34:28 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:34:28 user nova-compute[75354]:     <video>
Nov 14 06:34:28 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:34:28 user nova-compute[75354]:     </video>
Nov 14 06:34:28 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:34:28 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:34:28 user nova-compute[75354]:     </rng>
Nov 14 06:34:28 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:34:28 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:34:28 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:34:28 user nova-compute[75354]:     </memballoon>
Nov 14 06:34:28 user nova-compute[75354]:   </devices>
Nov 14 06:34:28 user nova-compute[75354]: </domain>
Nov 14 06:34:28 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771886086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771886086',id=16,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-sgebyxq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:34:27Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=2b2f22af-1a41-4747-9a16-561e260d5f63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG os_vif [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03f8d77b-0d1d-5144-a2bd-fd2c3ae6c345', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96458fbf-41, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96458fbf-41, col_values=(('qos', UUID('585d7212-a53c-4f94-bc4a-6fe679ad5ed1')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96458fbf-41, col_values=(('external_ids', {'iface-id': '96458fbf-4165-4a69-92eb-c806810ef7e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:66:91', 'vm-uuid': '2b2f22af-1a41-4747-9a16-561e260d5f63'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:28 user nova-compute[75354]: INFO os_vif [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41')
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No VIF found with MAC fa:16:3e:d9:66:91, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.neutron [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updated VIF entry in instance network info cache for port 96458fbf-4165-4a69-92eb-c806810ef7e8. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG nova.network.neutron [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updating instance_info_cache with network_info: [{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-067832f4-15bd-48b8-bd8c-a0c15424114c req-43360c9a-946d-4965-b60c-cb60aaaae24d service nova] Releasing lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:34:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:34:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.597515106201172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Instance spawned successfully.
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Applying migration context for instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 as it has an incoming, in-progress migration 2aedc199-747b-4211-b631-8e996241c0dd. Migration status is finished {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 06:34:32 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating resource usage from migration 2aedc199-747b-4211-b631-8e996241c0dd
Nov 14 06:34:32 user nova-compute[75354]: INFO nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b96beb17-09e1-45a2-8699-8657baa034e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance afb399e4-fd36-455d-b7c7-ac160f32ce79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Migration 2aedc199-747b-4211-b631-8e996241c0dd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:34:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:34:32 user nova-compute[75354]: INFO nova.compute.manager [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Took 7.28 seconds to build instance.
Nov 14 06:34:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-402be5a3-431a-475b-9dd8-90c91cd40a12 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.392s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:34:33 user nova-compute[75354]: INFO nova.compute.claims [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Claim successful on node user
Nov 14 06:34:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:34:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:34:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.policy [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70d7d1261dfa452cacd628da418f7783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ecd6fc1944b583d57d14e2a0559e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:34:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Creating image(s)
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk 1073741824" returned: 0 in 0.051s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Successfully created port: 4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Cannot resize image /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Ensure instance console log exists: /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Successfully updated port: 4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing instance network info cache due to event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:34:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance network_info: |[{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Start _get_guest_xml network_info=[{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:34:36 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:34:36 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1340763703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1340763703',id=17,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmsF02ZEXdbuk9QCs7SA/txSVRgC3Oz0qX28z3E+1APothIULTiSmML0bF6mbyk32onsnJxKlsAmJGE2meQznKvtpPz0DI2w9hD7BN5iYM6qZPE2ASG0nBwBiy1nlRxFA==',key_name='tempest-keypair-1770135778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-yfqwzrrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=73aaf228-084d-4d35-acd9-27db3536287f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'pci_devices' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:34:36 user nova-compute[75354]:   <uuid>73aaf228-084d-4d35-acd9-27db3536287f</uuid>
Nov 14 06:34:36 user nova-compute[75354]:   <name>instance-00000011</name>
Nov 14 06:34:36 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:34:36 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:34:36 user nova-compute[75354]:   <metadata>
Nov 14 06:34:36 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:34:36 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:34:36 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1340763703</nova:name>
Nov 14 06:34:36 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:34:36</nova:creationTime>
Nov 14 06:34:36 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:34:36 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:34:36 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:34:36 user nova-compute[75354]:       <nova:owner>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:user uuid="70d7d1261dfa452cacd628da418f7783">tempest-AttachVolumeShelveTestJSON-443282580-project-member</nova:user>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:project uuid="00f5ecd6fc1944b583d57d14e2a0559e">tempest-AttachVolumeShelveTestJSON-443282580</nova:project>
Nov 14 06:34:36 user nova-compute[75354]:       </nova:owner>
Nov 14 06:34:36 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:34:36 user nova-compute[75354]:       <nova:ports>
Nov 14 06:34:36 user nova-compute[75354]:         <nova:port uuid="4861783a-e44a-4b1b-9edb-016d3d2cf8ef">
Nov 14 06:34:36 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 06:34:36 user nova-compute[75354]:         </nova:port>
Nov 14 06:34:36 user nova-compute[75354]:       </nova:ports>
Nov 14 06:34:36 user nova-compute[75354]:     </nova:instance>
Nov 14 06:34:36 user nova-compute[75354]:   </metadata>
Nov 14 06:34:36 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:34:36 user nova-compute[75354]:     <system>
Nov 14 06:34:36 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:34:36 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:34:36 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:34:36 user nova-compute[75354]:       <entry name="serial">73aaf228-084d-4d35-acd9-27db3536287f</entry>
Nov 14 06:34:36 user nova-compute[75354]:       <entry name="uuid">73aaf228-084d-4d35-acd9-27db3536287f</entry>
Nov 14 06:34:36 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:34:36 user nova-compute[75354]:     </system>
Nov 14 06:34:36 user nova-compute[75354]:   </sysinfo>
Nov 14 06:34:36 user nova-compute[75354]:   <os>
Nov 14 06:34:36 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:34:36 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:34:36 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:34:36 user nova-compute[75354]:   </os>
Nov 14 06:34:36 user nova-compute[75354]:   <features>
Nov 14 06:34:36 user nova-compute[75354]:     <acpi/>
Nov 14 06:34:36 user nova-compute[75354]:     <apic/>
Nov 14 06:34:36 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:34:36 user nova-compute[75354]:   </features>
Nov 14 06:34:36 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:34:36 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:34:36 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:34:36 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:34:36 user nova-compute[75354]:   </clock>
Nov 14 06:34:36 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:34:36 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:34:36 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:34:36 user nova-compute[75354]:   </cpu>
Nov 14 06:34:36 user nova-compute[75354]:   <devices>
Nov 14 06:34:36 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:34:36 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:34:36 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk"/>
Nov 14 06:34:36 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:34:36 user nova-compute[75354]:     </disk>
Nov 14 06:34:36 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:34:36 user nova-compute[75354]:       <mac address="fa:16:3e:1c:f3:d6"/>
Nov 14 06:34:36 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:34:36 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:34:36 user nova-compute[75354]:       <target dev="tap4861783a-e4"/>
Nov 14 06:34:36 user nova-compute[75354]:     </interface>
Nov 14 06:34:36 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:34:36 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/console.log" append="off"/>
Nov 14 06:34:36 user nova-compute[75354]:     </serial>
Nov 14 06:34:36 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:34:36 user nova-compute[75354]:     <video>
Nov 14 06:34:36 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:34:36 user nova-compute[75354]:     </video>
Nov 14 06:34:36 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:34:36 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:34:36 user nova-compute[75354]:     </rng>
Nov 14 06:34:36 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:34:36 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:34:36 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:34:36 user nova-compute[75354]:     </memballoon>
Nov 14 06:34:36 user nova-compute[75354]:   </devices>
Nov 14 06:34:36 user nova-compute[75354]: </domain>
Nov 14 06:34:36 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1340763703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1340763703',id=17,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmsF02ZEXdbuk9QCs7SA/txSVRgC3Oz0qX28z3E+1APothIULTiSmML0bF6mbyk32onsnJxKlsAmJGE2meQznKvtpPz0DI2w9hD7BN5iYM6qZPE2ASG0nBwBiy1nlRxFA==',key_name='tempest-keypair-1770135778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-yfqwzrrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=73aaf228-084d-4d35-acd9-27db3536287f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG os_vif [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19881b81-e345-53af-b862-1f676e0ecd75', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4861783a-e4, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4861783a-e4, col_values=(('qos', UUID('820ad0ed-bc91-4541-af3a-a649c8f4b690')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4861783a-e4, col_values=(('external_ids', {'iface-id': '4861783a-e44a-4b1b-9edb-016d3d2cf8ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:f3:d6', 'vm-uuid': '73aaf228-084d-4d35-acd9-27db3536287f'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:36 user nova-compute[75354]: INFO os_vif [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4')
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No VIF found with MAC fa:16:3e:1c:f3:d6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updated VIF entry in instance network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5e33268c-9565-413c-bd6f-b31174646c24 req-5611d3fe-185e-4841-96ae-b40e202b06c2 service nova] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] No waiting events found dispatching network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:34:37 user nova-compute[75354]: WARNING nova.compute.manager [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received unexpected event network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 for instance with vm_state active and task_state None.
Nov 14 06:34:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] No waiting events found dispatching network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:34:37 user nova-compute[75354]: WARNING nova.compute.manager [req-7ce57be2-a71f-4aa8-bb7e-17cc9861dd6d req-ce56e4cc-5de8-494b-b643-32cba62ddeb0 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received unexpected event network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 for instance with vm_state active and task_state None.
Nov 14 06:34:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8380435-da2c-4738-ae8a-400c48cb1662 req-859b6648-8ffe-4b4d-a14f-4cb0128da824 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8380435-da2c-4738-ae8a-400c48cb1662 req-859b6648-8ffe-4b4d-a14f-4cb0128da824 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8380435-da2c-4738-ae8a-400c48cb1662 req-859b6648-8ffe-4b4d-a14f-4cb0128da824 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8380435-da2c-4738-ae8a-400c48cb1662 req-859b6648-8ffe-4b4d-a14f-4cb0128da824 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8380435-da2c-4738-ae8a-400c48cb1662 req-859b6648-8ffe-4b4d-a14f-4cb0128da824 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:34:38 user nova-compute[75354]: WARNING nova.compute.manager [req-c8380435-da2c-4738-ae8a-400c48cb1662 req-859b6648-8ffe-4b4d-a14f-4cb0128da824 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state building and task_state spawning.
Nov 14 06:34:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:34:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance spawned successfully.
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:34:40 user nova-compute[75354]: INFO nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-e71f3972-5ec3-4031-96ad-c284096af7b2 req-4f98df32-462e-4bd9-9ed8-14d51bc0f504 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e71f3972-5ec3-4031-96ad-c284096af7b2 req-4f98df32-462e-4bd9-9ed8-14d51bc0f504 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e71f3972-5ec3-4031-96ad-c284096af7b2 req-4f98df32-462e-4bd9-9ed8-14d51bc0f504 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e71f3972-5ec3-4031-96ad-c284096af7b2 req-4f98df32-462e-4bd9-9ed8-14d51bc0f504 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-e71f3972-5ec3-4031-96ad-c284096af7b2 req-4f98df32-462e-4bd9-9ed8-14d51bc0f504 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:34:40 user nova-compute[75354]: WARNING nova.compute.manager [req-e71f3972-5ec3-4031-96ad-c284096af7b2 req-4f98df32-462e-4bd9-9ed8-14d51bc0f504 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state building and task_state spawning.
Nov 14 06:34:40 user nova-compute[75354]: INFO nova.compute.manager [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Took 7.07 seconds to build instance.
Nov 14 06:34:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c268b87f-c3f9-49a0-8f94-9eb4f9139ca1 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.169s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "afb399e4-fd36-455d-b7c7-ac160f32ce79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.006s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:43 user nova-compute[75354]: INFO nova.compute.manager [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Terminating instance
Nov 14 06:34:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Instance destroyed successfully.
Nov 14 06:34:44 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'resources' on Instance uuid afb399e4-fd36-455d-b7c7-ac160f32ce79 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-726907842',display_name='tempest-VolumesAdminNegativeTest-server-726907842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-726907842',id=12,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:32:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f1f7375b4ed4d649edad03899ab4446',ramdisk_id='',reservation_id='r-bdz2kq1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1431300602',owner_user_name='tempest-VolumesAdminNegativeTest-1431300602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:32:57Z,user_data=None,user_id='fdace4f11a3f4e95862b8c979e82d7ab',uuid=afb399e4-fd36-455d-b7c7-ac160f32ce79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converting VIF {"id": "5acecc8d-5c66-4713-a01e-663b1241309b", "address": "fa:16:3e:00:50:46", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acecc8d-5c", "ovs_interfaceid": "5acecc8d-5c66-4713-a01e-663b1241309b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG os_vif [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5acecc8d-5c, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73875902-6283-420d-8f5c-d2e021921643) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:34:44 user nova-compute[75354]: INFO os_vif [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:50:46,bridge_name='br-int',has_traffic_filtering=True,id=5acecc8d-5c66-4713-a01e-663b1241309b,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acecc8d-5c')
Nov 14 06:34:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Deleting instance files /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79_del
Nov 14 06:34:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Deletion of /opt/stack/data/nova/instances/afb399e4-fd36-455d-b7c7-ac160f32ce79_del complete
Nov 14 06:34:44 user nova-compute[75354]: INFO nova.compute.manager [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 06:34:44 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:34:44 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:34:45 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:45 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Took 0.51 seconds to deallocate network for instance.
Nov 14 06:34:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-f8a95a17-1179-4e6c-985b-7de3fbdf093e req-a74d8f70-5644-481c-8dab-66a8bf4fe871 service nova] [instance: afb399e4-fd36-455d-b7c7-ac160f32ce79] Received event network-vif-deleted-5acecc8d-5c66-4713-a01e-663b1241309b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:45 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:34:45 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:34:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:45 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Deleted allocations for instance afb399e4-fd36-455d-b7c7-ac160f32ce79
Nov 14 06:34:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f035c2f0-a7c4-49d2-844b-614e884af6c9 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "afb399e4-fd36-455d-b7c7-ac160f32ce79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.120s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:34:57 user nova-compute[75354]: INFO nova.compute.claims [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Claim successful on node user
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:34:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.policy [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61fe146c06734be7a7039cb754015019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd9f605474fe8a451637996110491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:34:57 user nova-compute[75354]: INFO nova.virt.block_device [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Booting with volume 2e86fa27-bf93-42c5-8dd9-45e429842a02 at /dev/vda
Nov 14 06:34:57 user nova-compute[75354]: DEBUG os_brick.utils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa308f-5f18-4721-aad7-1eeba9a3406b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba93127f-63db-468e-9567-c3b98f29d425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4670a96-7aae-418e-b408-e4d33caa0d88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44039d1-041f-477c-87fb-b75d4d91436e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:34:57 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:34:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa09ae0-aee8-486c-b617-40fca60017d1]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG os_brick.utils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:34:57 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating existing volume attachment record: 57b9b831-d0ae-4587-ae14-f57c3269a720 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Successfully created port: 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Successfully updated port: 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing instance network info cache due to event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:34:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.network.neutron [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance network_info: |[{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:34:59 user nova-compute[75354]: INFO nova.compute.claims [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Claim successful on node user
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updated VIF entry in instance network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-52f316f7-a1d4-4bb2-b3e4-b04c61a84914 req-40638865-7424-4e5e-8b99-dd18da1d4fe3 service nova] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.network.neutron [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:34:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:34:59 user nova-compute[75354]: DEBUG nova.policy [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1db86d1a052c40678cb7e4efe76a6dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10d2458fb34f8fb75bf2d227b047b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:35:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Creating image(s)
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.209s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk 1073741824" returned: 0 in 0.048s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.network.neutron [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Successfully created port: b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.220s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Cannot resize image /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Ensure instance console log exists: /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG nova.network.neutron [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Successfully updated port: b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG nova.network.neutron [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing instance network info cache due to event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:01 user nova-compute[75354]: DEBUG nova.network.neutron [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance network_info: |[{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Start _get_guest_xml network_info=[{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:35:02 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:02 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-345416593',display_name='tempest-ServerStableDeviceRescueTest-server-345416593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-345416593',id=19,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZR5pP6FsBgkL8Zrc4FgO5hbq2x8EryNGCtSLww6ZvFPZMwxvSVBkedxHUJHZOdxGyzz6rqx3IaItfVR0WBep5naWgrGI0ci+APiVyPKKNlIoNQczcjWiyoCHKtsvFmmA==',key_name='tempest-keypair-505318022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c10d2458fb34f8fb75bf2d227b047b8',ramdisk_id='',reservation_id='r-je2ls6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1966013656',owner_user_name='tempest-ServerStableDeviceRescueTest-1966013656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:35:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db86d1a052c40678cb7e4efe76a6dd9',uuid=5c304a52-fe97-4cf5-88fc-cda18858cf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converting VIF {"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.objects.instance [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:35:02 user nova-compute[75354]:   <uuid>5c304a52-fe97-4cf5-88fc-cda18858cf50</uuid>
Nov 14 06:35:02 user nova-compute[75354]:   <name>instance-00000013</name>
Nov 14 06:35:02 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:35:02 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:35:02 user nova-compute[75354]:   <metadata>
Nov 14 06:35:02 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:35:02 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:35:02 user nova-compute[75354]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-345416593</nova:name>
Nov 14 06:35:02 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:35:02</nova:creationTime>
Nov 14 06:35:02 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:35:02 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:35:02 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:35:02 user nova-compute[75354]:       <nova:owner>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:user uuid="1db86d1a052c40678cb7e4efe76a6dd9">tempest-ServerStableDeviceRescueTest-1966013656-project-member</nova:user>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:project uuid="4c10d2458fb34f8fb75bf2d227b047b8">tempest-ServerStableDeviceRescueTest-1966013656</nova:project>
Nov 14 06:35:02 user nova-compute[75354]:       </nova:owner>
Nov 14 06:35:02 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:35:02 user nova-compute[75354]:       <nova:ports>
Nov 14 06:35:02 user nova-compute[75354]:         <nova:port uuid="b8ea2ee8-43e9-42bc-96d1-aa78c39beca1">
Nov 14 06:35:02 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 06:35:02 user nova-compute[75354]:         </nova:port>
Nov 14 06:35:02 user nova-compute[75354]:       </nova:ports>
Nov 14 06:35:02 user nova-compute[75354]:     </nova:instance>
Nov 14 06:35:02 user nova-compute[75354]:   </metadata>
Nov 14 06:35:02 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:35:02 user nova-compute[75354]:     <system>
Nov 14 06:35:02 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:35:02 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:35:02 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:35:02 user nova-compute[75354]:       <entry name="serial">5c304a52-fe97-4cf5-88fc-cda18858cf50</entry>
Nov 14 06:35:02 user nova-compute[75354]:       <entry name="uuid">5c304a52-fe97-4cf5-88fc-cda18858cf50</entry>
Nov 14 06:35:02 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:35:02 user nova-compute[75354]:     </system>
Nov 14 06:35:02 user nova-compute[75354]:   </sysinfo>
Nov 14 06:35:02 user nova-compute[75354]:   <os>
Nov 14 06:35:02 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:35:02 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:35:02 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:35:02 user nova-compute[75354]:   </os>
Nov 14 06:35:02 user nova-compute[75354]:   <features>
Nov 14 06:35:02 user nova-compute[75354]:     <acpi/>
Nov 14 06:35:02 user nova-compute[75354]:     <apic/>
Nov 14 06:35:02 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:35:02 user nova-compute[75354]:   </features>
Nov 14 06:35:02 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:35:02 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:35:02 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:35:02 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:35:02 user nova-compute[75354]:   </clock>
Nov 14 06:35:02 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:35:02 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:35:02 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:35:02 user nova-compute[75354]:   </cpu>
Nov 14 06:35:02 user nova-compute[75354]:   <devices>
Nov 14 06:35:02 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:35:02 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:35:02 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk"/>
Nov 14 06:35:02 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:35:02 user nova-compute[75354]:     </disk>
Nov 14 06:35:02 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:35:02 user nova-compute[75354]:       <mac address="fa:16:3e:ac:7f:c4"/>
Nov 14 06:35:02 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:02 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:35:02 user nova-compute[75354]:       <target dev="tapb8ea2ee8-43"/>
Nov 14 06:35:02 user nova-compute[75354]:     </interface>
Nov 14 06:35:02 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:35:02 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/console.log" append="off"/>
Nov 14 06:35:02 user nova-compute[75354]:     </serial>
Nov 14 06:35:02 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:35:02 user nova-compute[75354]:     <video>
Nov 14 06:35:02 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:02 user nova-compute[75354]:     </video>
Nov 14 06:35:02 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:35:02 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:35:02 user nova-compute[75354]:     </rng>
Nov 14 06:35:02 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:35:02 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:35:02 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:35:02 user nova-compute[75354]:     </memballoon>
Nov 14 06:35:02 user nova-compute[75354]:   </devices>
Nov 14 06:35:02 user nova-compute[75354]: </domain>
Nov 14 06:35:02 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-345416593',display_name='tempest-ServerStableDeviceRescueTest-server-345416593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-345416593',id=19,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZR5pP6FsBgkL8Zrc4FgO5hbq2x8EryNGCtSLww6ZvFPZMwxvSVBkedxHUJHZOdxGyzz6rqx3IaItfVR0WBep5naWgrGI0ci+APiVyPKKNlIoNQczcjWiyoCHKtsvFmmA==',key_name='tempest-keypair-505318022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c10d2458fb34f8fb75bf2d227b047b8',ramdisk_id='',reservation_id='r-je2ls6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1966013656',owner_user_name='tempest-ServerStableDeviceRescueTest-1966013656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:35:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db86d1a052c40678cb7e4efe76a6dd9',uuid=5c304a52-fe97-4cf5-88fc-cda18858cf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converting VIF {"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_vif [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f1ceb83-df0e-5809-9790-9ab04497ba7a', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8ea2ee8-43, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8ea2ee8-43, col_values=(('qos', UUID('8efac2d5-9602-4d4c-9717-77ca5a8b69d4')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8ea2ee8-43, col_values=(('external_ids', {'iface-id': 'b8ea2ee8-43e9-42bc-96d1-aa78c39beca1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:7f:c4', 'vm-uuid': '5c304a52-fe97-4cf5-88fc-cda18858cf50'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:02 user nova-compute[75354]: INFO os_vif [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43')
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No VIF found with MAC fa:16:3e:ac:7f:c4, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:35:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Creating image(s)
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Ensure instance console log exists: /opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Start _get_guest_xml network_info=[{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '616cd639-1e6f-4bed-8cba-7da50d65a4d6', 'attached_at': '', 'detached_at': '', 'volume_id': '2e86fa27-bf93-42c5-8dd9-45e429842a02', 'serial': '2e86fa27-bf93-42c5-8dd9-45e429842a02'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '57b9b831-d0ae-4587-ae14-f57c3269a720', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:35:02 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:02 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updated VIF entry in instance network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:02 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:02 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:02 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-51f2f444-e1d0-4867-bba8-63eca076252b req-967be16b-a6d4-4772-811b-49c6e95efd1e service nova] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea283d-938e-4dfd-8d07-17064d0b5f9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:35:02 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88fea8e-098d-4ef2-9904-ea83767a62a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02] added
Nov 14 06:35:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4657b54-c3d1-49ec-9fc4-15a76df5ed15]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[119cdf78-f4b8-43f3-8f10-0be6d38f2f2c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaXNJxcr {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaXNJxcr" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cdcaf0-0c66-43be-b810-dab4d9c709ec]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oaXNJxcr'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05cf1a-bc0d-4f23-a78a-af500b718302]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225d67d-1598-4cc0-9cb7-40081a1d2773]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:02 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:02 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d246f8e-acef-4f22-abd8-d0e8c5442b12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]
Nov 14 06:35:02 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.
Nov 14 06:35:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e5cc8d-92e4-4ad1-acc6-557a2874260e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1674086-2c2f-46bc-86df-90fef4c7e290]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:02 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:02 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:02 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:02 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe27d024-9cec-4327-8f6c-fba4388e89fe]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23536653830366439', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536653830366439', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2003753906',display_name='tempest-TestShelveInstance-server-2003753906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2003753906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+xkObWm0gP6pbiax4KJmPMne8Cjeb+Ks9EthgdyaDozYtxbVfp17rzTIU/i2zP6ul08alPIhgqvZeBPR4hOTQy/3lBA5dtT2s4aJNMg5U4BtVFfohCoMRmivNTMlfT8g==',key_name='tempest-TestShelveInstance-578191332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1cd9f605474fe8a451637996110491',ramdisk_id='',reservation_id='r-0eh2op4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1170608310',owner_user_name='tempest-TestShelveInstance-1170608310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:34:58Z,user_data=None,user_id='61fe146c06734be7a7039cb754015019',uuid=616cd639-1e6f-4bed-8cba-7da50d65a4d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converting VIF {"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.objects.instance [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'pci_devices' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:35:03 user nova-compute[75354]:   <uuid>616cd639-1e6f-4bed-8cba-7da50d65a4d6</uuid>
Nov 14 06:35:03 user nova-compute[75354]:   <name>instance-00000012</name>
Nov 14 06:35:03 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:35:03 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:35:03 user nova-compute[75354]:   <metadata>
Nov 14 06:35:03 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:35:03 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:35:03 user nova-compute[75354]:       <nova:name>tempest-TestShelveInstance-server-2003753906</nova:name>
Nov 14 06:35:03 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:35:02</nova:creationTime>
Nov 14 06:35:03 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:35:03 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:35:03 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:35:03 user nova-compute[75354]:       <nova:owner>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:user uuid="61fe146c06734be7a7039cb754015019">tempest-TestShelveInstance-1170608310-project-member</nova:user>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:project uuid="ba1cd9f605474fe8a451637996110491">tempest-TestShelveInstance-1170608310</nova:project>
Nov 14 06:35:03 user nova-compute[75354]:       </nova:owner>
Nov 14 06:35:03 user nova-compute[75354]:       <nova:ports>
Nov 14 06:35:03 user nova-compute[75354]:         <nova:port uuid="889d4a14-a052-4bea-91b7-639f6fd83e58">
Nov 14 06:35:03 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:35:03 user nova-compute[75354]:         </nova:port>
Nov 14 06:35:03 user nova-compute[75354]:       </nova:ports>
Nov 14 06:35:03 user nova-compute[75354]:     </nova:instance>
Nov 14 06:35:03 user nova-compute[75354]:   </metadata>
Nov 14 06:35:03 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:35:03 user nova-compute[75354]:     <system>
Nov 14 06:35:03 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:35:03 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:35:03 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:35:03 user nova-compute[75354]:       <entry name="serial">616cd639-1e6f-4bed-8cba-7da50d65a4d6</entry>
Nov 14 06:35:03 user nova-compute[75354]:       <entry name="uuid">616cd639-1e6f-4bed-8cba-7da50d65a4d6</entry>
Nov 14 06:35:03 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:35:03 user nova-compute[75354]:     </system>
Nov 14 06:35:03 user nova-compute[75354]:   </sysinfo>
Nov 14 06:35:03 user nova-compute[75354]:   <os>
Nov 14 06:35:03 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:35:03 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:35:03 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:35:03 user nova-compute[75354]:   </os>
Nov 14 06:35:03 user nova-compute[75354]:   <features>
Nov 14 06:35:03 user nova-compute[75354]:     <acpi/>
Nov 14 06:35:03 user nova-compute[75354]:     <apic/>
Nov 14 06:35:03 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:35:03 user nova-compute[75354]:   </features>
Nov 14 06:35:03 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:35:03 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:35:03 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:35:03 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:35:03 user nova-compute[75354]:   </clock>
Nov 14 06:35:03 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:35:03 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:35:03 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:35:03 user nova-compute[75354]:   </cpu>
Nov 14 06:35:03 user nova-compute[75354]:   <devices>
Nov 14 06:35:03 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:35:03 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:35:03 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 06:35:03 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:35:03 user nova-compute[75354]:       <serial>2e86fa27-bf93-42c5-8dd9-45e429842a02</serial>
Nov 14 06:35:03 user nova-compute[75354]:     </disk>
Nov 14 06:35:03 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:35:03 user nova-compute[75354]:       <mac address="fa:16:3e:8d:80:e5"/>
Nov 14 06:35:03 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:03 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:35:03 user nova-compute[75354]:       <target dev="tap889d4a14-a0"/>
Nov 14 06:35:03 user nova-compute[75354]:     </interface>
Nov 14 06:35:03 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:35:03 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6/console.log" append="off"/>
Nov 14 06:35:03 user nova-compute[75354]:     </serial>
Nov 14 06:35:03 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:35:03 user nova-compute[75354]:     <video>
Nov 14 06:35:03 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:03 user nova-compute[75354]:     </video>
Nov 14 06:35:03 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:35:03 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:35:03 user nova-compute[75354]:     </rng>
Nov 14 06:35:03 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:35:03 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:35:03 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:35:03 user nova-compute[75354]:     </memballoon>
Nov 14 06:35:03 user nova-compute[75354]:   </devices>
Nov 14 06:35:03 user nova-compute[75354]: </domain>
Nov 14 06:35:03 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2003753906',display_name='tempest-TestShelveInstance-server-2003753906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2003753906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+xkObWm0gP6pbiax4KJmPMne8Cjeb+Ks9EthgdyaDozYtxbVfp17rzTIU/i2zP6ul08alPIhgqvZeBPR4hOTQy/3lBA5dtT2s4aJNMg5U4BtVFfohCoMRmivNTMlfT8g==',key_name='tempest-TestShelveInstance-578191332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1cd9f605474fe8a451637996110491',ramdisk_id='',reservation_id='r-0eh2op4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1170608310',owner_user_name='tempest-TestShelveInstance-1170608310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:34:58Z,user_data=None,user_id='61fe146c06734be7a7039cb754015019',uuid=616cd639-1e6f-4bed-8cba-7da50d65a4d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converting VIF {"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG os_vif [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8326e75-4288-54e6-9faa-194e1aff1a77', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap889d4a14-a0, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap889d4a14-a0, col_values=(('qos', UUID('42afe3c7-b3c6-4a37-a42e-18481bffdac5')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap889d4a14-a0, col_values=(('external_ids', {'iface-id': '889d4a14-a052-4bea-91b7-639f6fd83e58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:80:e5', 'vm-uuid': '616cd639-1e6f-4bed-8cba-7da50d65a4d6'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:03 user nova-compute[75354]: INFO os_vif [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0')
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:35:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] No VIF found with MAC fa:16:3e:8d:80:e5, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-5cf1cd1f-4432-458a-8f55-82e4eb67f988 req-32d43ca6-e7ec-434b-b098-1e2cef57add2 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5cf1cd1f-4432-458a-8f55-82e4eb67f988 req-32d43ca6-e7ec-434b-b098-1e2cef57add2 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5cf1cd1f-4432-458a-8f55-82e4eb67f988 req-32d43ca6-e7ec-434b-b098-1e2cef57add2 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5cf1cd1f-4432-458a-8f55-82e4eb67f988 req-32d43ca6-e7ec-434b-b098-1e2cef57add2 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-5cf1cd1f-4432-458a-8f55-82e4eb67f988 req-32d43ca6-e7ec-434b-b098-1e2cef57add2 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:04 user nova-compute[75354]: WARNING nova.compute.manager [req-5cf1cd1f-4432-458a-8f55-82e4eb67f988 req-32d43ca6-e7ec-434b-b098-1e2cef57add2 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state building and task_state spawning.
Nov 14 06:35:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-8384d799-e39b-4e0f-9a0b-03e442a6048e req-f2e7b963-ef78-4056-b7b4-9487e2b87d15 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8384d799-e39b-4e0f-9a0b-03e442a6048e req-f2e7b963-ef78-4056-b7b4-9487e2b87d15 service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8384d799-e39b-4e0f-9a0b-03e442a6048e req-f2e7b963-ef78-4056-b7b4-9487e2b87d15 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8384d799-e39b-4e0f-9a0b-03e442a6048e req-f2e7b963-ef78-4056-b7b4-9487e2b87d15 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-8384d799-e39b-4e0f-9a0b-03e442a6048e req-f2e7b963-ef78-4056-b7b4-9487e2b87d15 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:05 user nova-compute[75354]: WARNING nova.compute.manager [req-8384d799-e39b-4e0f-9a0b-03e442a6048e req-f2e7b963-ef78-4056-b7b4-9487e2b87d15 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state building and task_state spawning.
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:35:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance spawned successfully.
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:05 user nova-compute[75354]: INFO nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 14 06:35:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:35:05 user nova-compute[75354]: INFO nova.compute.manager [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Took 6.70 seconds to build instance.
Nov 14 06:35:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94969ddb-c286-42fd-a21c-ea68ce21104e tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.800s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-4b554c25-36b1-4d80-a4e0-dd36a710f4e7 req-55cd0f73-5087-4ff9-a02a-60838b5f0a7d service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4b554c25-36b1-4d80-a4e0-dd36a710f4e7 req-55cd0f73-5087-4ff9-a02a-60838b5f0a7d service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4b554c25-36b1-4d80-a4e0-dd36a710f4e7 req-55cd0f73-5087-4ff9-a02a-60838b5f0a7d service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4b554c25-36b1-4d80-a4e0-dd36a710f4e7 req-55cd0f73-5087-4ff9-a02a-60838b5f0a7d service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-4b554c25-36b1-4d80-a4e0-dd36a710f4e7 req-55cd0f73-5087-4ff9-a02a-60838b5f0a7d service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:06 user nova-compute[75354]: WARNING nova.compute.manager [req-4b554c25-36b1-4d80-a4e0-dd36a710f4e7 req-55cd0f73-5087-4ff9-a02a-60838b5f0a7d service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state active and task_state None.
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:35:07 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance spawned successfully.
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:35:07 user nova-compute[75354]: INFO nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-776026cf-ebca-4146-ac38-fc00ff8476f6 req-5f931477-1897-4ff0-95b4-8b4e46bc4c76 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-776026cf-ebca-4146-ac38-fc00ff8476f6 req-5f931477-1897-4ff0-95b4-8b4e46bc4c76 service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-776026cf-ebca-4146-ac38-fc00ff8476f6 req-5f931477-1897-4ff0-95b4-8b4e46bc4c76 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-776026cf-ebca-4146-ac38-fc00ff8476f6 req-5f931477-1897-4ff0-95b4-8b4e46bc4c76 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-776026cf-ebca-4146-ac38-fc00ff8476f6 req-5f931477-1897-4ff0-95b4-8b4e46bc4c76 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:07 user nova-compute[75354]: WARNING nova.compute.manager [req-776026cf-ebca-4146-ac38-fc00ff8476f6 req-5f931477-1897-4ff0-95b4-8b4e46bc4c76 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state building and task_state spawning.
Nov 14 06:35:07 user nova-compute[75354]: INFO nova.compute.manager [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Took 10.81 seconds to build instance.
Nov 14 06:35:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd069331-566f-4420-b6df-f90c387fac22 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.922s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Port 307913af-8833-4c78-8600-a43bbc913f5a binding to destination host user is already ACTIVE {{(pid=75354) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Creating tmpfile /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/tmpi__496jo to verify with other compute node that the instance is on the same shared storage. {{(pid=75354) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-bab9dfa6-7ece-40ff-a644-ae05776a7f93 req-6f41e8df-eb4d-427e-9fb0-ef519e9b9629 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bab9dfa6-7ece-40ff-a644-ae05776a7f93 req-6f41e8df-eb4d-427e-9fb0-ef519e9b9629 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bab9dfa6-7ece-40ff-a644-ae05776a7f93 req-6f41e8df-eb4d-427e-9fb0-ef519e9b9629 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bab9dfa6-7ece-40ff-a644-ae05776a7f93 req-6f41e8df-eb4d-427e-9fb0-ef519e9b9629 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-bab9dfa6-7ece-40ff-a644-ae05776a7f93 req-6f41e8df-eb4d-427e-9fb0-ef519e9b9629 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:20 user nova-compute[75354]: WARNING nova.compute.manager [req-bab9dfa6-7ece-40ff-a644-ae05776a7f93 req-6f41e8df-eb4d-427e-9fb0-ef519e9b9629 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state resized and task_state resize_reverting.
Nov 14 06:35:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance destroyed successfully.
Nov 14 06:35:21 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'resources' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307913af-88, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab327a33-6172-4d75-afe4-597da823b478) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:21 user nova-compute[75354]: INFO os_vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88')
Nov 14 06:35:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:21 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff2748b-73a5-47b0-a92c-5dd1c6ac2278]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:35:21 user nova-compute[75354]: No targets found.
Nov 14 06:35:21 user nova-compute[75354]: iSNS:
Nov 14 06:35:21 user nova-compute[75354]: No targets found.
Nov 14 06:35:21 user nova-compute[75354]: STATIC:
Nov 14 06:35:21 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:35:21 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:35:21 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:35:21 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:35:21 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:35:21 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:35:21 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:35:21 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:35:21 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:35:21 user nova-compute[75354]: FIRMWARE:
Nov 14 06:35:21 user nova-compute[75354]: No targets found.
Nov 14 06:35:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:35:21 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:35:21 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce295a6d-ff45-49a2-90f9-47dd704a8075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa6f311-c5ff-46a3-aa24-1186bfd3d164]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:21 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:21 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:21 user nova-compute[75354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:21 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074215cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e0c1c-701c-439d-8fcc-ef41665c421f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[657fb199-3c89-4163-ae6c-6a84aed74be7]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4538f97-06c4-4fe2-a4f1-17016b96c11b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[da877ac7-634b-44c2-9625-c7c434e0fb7b]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b327a9-6a95-47b6-8542-d1035be19c54]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea73f74-5cda-4af0-bc03-9d6c1e1c6813]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]
Nov 14 06:35:21 user nova-compute[75354]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.
Nov 14 06:35:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b8b215-7fd4-4c5c-b43f-16213cc4087b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== disconnect_volume: return (350ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'migration_context' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG nova.objects.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Object Instance<787b732d-c4cc-4cf1-8069-6a8d0458b3b9> lazy-loaded attributes: resources,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-9c4e3874-8b41-4666-9b2e-fced5fd5b5f6 req-97136f6b-5ffb-4c9e-a4b9-6592d7dd6bf6 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9c4e3874-8b41-4666-9b2e-fced5fd5b5f6 req-97136f6b-5ffb-4c9e-a4b9-6592d7dd6bf6 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9c4e3874-8b41-4666-9b2e-fced5fd5b5f6 req-97136f6b-5ffb-4c9e-a4b9-6592d7dd6bf6 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9c4e3874-8b41-4666-9b2e-fced5fd5b5f6 req-97136f6b-5ffb-4c9e-a4b9-6592d7dd6bf6 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-9c4e3874-8b41-4666-9b2e-fced5fd5b5f6 req-97136f6b-5ffb-4c9e-a4b9-6592d7dd6bf6 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:22 user nova-compute[75354]: WARNING nova.compute.manager [req-9c4e3874-8b41-4666-9b2e-fced5fd5b5f6 req-97136f6b-5ffb-4c9e-a4b9-6592d7dd6bf6 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state resized and task_state resize_reverting.
Nov 14 06:35:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.408s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:23 user nova-compute[75354]: INFO nova.compute.manager [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Detaching volume 6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:35:23 user nova-compute[75354]: INFO nova.compute.manager [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Swapping old allocation on dict_keys(['639f2b20-6e4a-4044-8740-35d2f7c0a858']) held by migration 2aedc199-747b-4211-b631-8e996241c0dd for instance
Nov 14 06:35:23 user nova-compute[75354]: INFO nova.virt.block_device [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Attempting to driver detach volume 6e4ddb08-ad6c-4d7b-952a-5c9793268241 from mountpoint /dev/vdb
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Attempting to detach device vdb from instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:35:23 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:35:23 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:35:23 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:35:23 user nova-compute[75354]:   <serial>6e4ddb08-ad6c-4d7b-952a-5c9793268241</serial>
Nov 14 06:35:23 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 06:35:23 user nova-compute[75354]: </disk>
Nov 14 06:35:23 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:35:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully detached device vdb from instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd from the persistent domain config.
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:35:23 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:35:23 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:35:23 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:35:23 user nova-compute[75354]:   <serial>6e4ddb08-ad6c-4d7b-952a-5c9793268241</serial>
Nov 14 06:35:23 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 06:35:23 user nova-compute[75354]: </disk>
Nov 14 06:35:23 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Overwriting current allocation {'allocations': {'639f2b20-6e4a-4044-8740-35d2f7c0a858': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'a152b44325b84778b31a79b9faf1b443', 'user_id': '7678e8df1dc94bb999962858edc7ec5f', 'consumer_generation': 1} on consumer 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:35:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG os_brick.utils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebdafc3-9fae-4f4f-98bf-2f83fcf1338c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd4962-8793-4f2f-b3a7-d6dbd44ec804]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dcd76c-1d90-4c73-a5ab-f1ba6dcc8308]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f79f37f-f963-468d-ae84-0abe864a1304]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:35:24 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:35:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a4797c-43d7-421e-93af-216f1fb1905a]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:35:24 user nova-compute[75354]: DEBUG os_brick.utils [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Starting finish_revert_migration {{(pid=75354) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start _get_guest_xml network_info=[{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '787b732d-c4cc-4cf1-8069-6a8d0458b3b9', 'attached_at': '2023-11-14T06:35:28.000000', 'detached_at': '', 'volume_id': '6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'serial': '6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '921d3a47-8ac3-4cee-84b2-dcb8e11a6509', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:28 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'vcpu_model' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:28 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd7b9b-d062-438c-8c40-787e1e918df3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:35:28 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be7361-1bee-49d4-aa9c-be1d8e11e8f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf] added
Nov 14 06:35:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee895842-773b-4d28-9f40-d32b12a63082]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a220a2c1-0ab5-468b-9de7-29c40bfaa567]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrIjaFCZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrIjaFCZ" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2808dd1b-7195-4278-a438-69d6ce761ffa]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrIjaFCZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12fd937-27fd-4d6a-8ead-42dba15f9e17]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[813824fa-a940-4600-a1a6-49bfd8425abf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:28 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:28 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95795bbf-8193-45b0-a73d-bc4d0e67b5e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]
Nov 14 06:35:28 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.
Nov 14 06:35:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c706e11-7754-4082-b64a-eacdfc4ed256]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a603253-a680-4cc9-814d-6d842db602a0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:29 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:29 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:29 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:29 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df357c4-cefe-4346-86c3-3389c510ab99]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26333373239316430', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333373239316430', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:35:30 user nova-compute[75354]:   <uuid>787b732d-c4cc-4cf1-8069-6a8d0458b3b9</uuid>
Nov 14 06:35:30 user nova-compute[75354]:   <name>instance-00000001</name>
Nov 14 06:35:30 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:35:30 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:35:30 user nova-compute[75354]:   <metadata>
Nov 14 06:35:30 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:35:30 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:35:30 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherB-server-924171002</nova:name>
Nov 14 06:35:30 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:35:28</nova:creationTime>
Nov 14 06:35:30 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:35:30 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:35:30 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:35:30 user nova-compute[75354]:       <nova:owner>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:user uuid="7678e8df1dc94bb999962858edc7ec5f">tempest-ServerActionsTestOtherB-766403064-project-member</nova:user>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:project uuid="a152b44325b84778b31a79b9faf1b443">tempest-ServerActionsTestOtherB-766403064</nova:project>
Nov 14 06:35:30 user nova-compute[75354]:       </nova:owner>
Nov 14 06:35:30 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:35:30 user nova-compute[75354]:       <nova:ports>
Nov 14 06:35:30 user nova-compute[75354]:         <nova:port uuid="307913af-8833-4c78-8600-a43bbc913f5a">
Nov 14 06:35:30 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 06:35:30 user nova-compute[75354]:         </nova:port>
Nov 14 06:35:30 user nova-compute[75354]:       </nova:ports>
Nov 14 06:35:30 user nova-compute[75354]:     </nova:instance>
Nov 14 06:35:30 user nova-compute[75354]:   </metadata>
Nov 14 06:35:30 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:35:30 user nova-compute[75354]:     <system>
Nov 14 06:35:30 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:35:30 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:35:30 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:35:30 user nova-compute[75354]:       <entry name="serial">787b732d-c4cc-4cf1-8069-6a8d0458b3b9</entry>
Nov 14 06:35:30 user nova-compute[75354]:       <entry name="uuid">787b732d-c4cc-4cf1-8069-6a8d0458b3b9</entry>
Nov 14 06:35:30 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:35:30 user nova-compute[75354]:     </system>
Nov 14 06:35:30 user nova-compute[75354]:   </sysinfo>
Nov 14 06:35:30 user nova-compute[75354]:   <os>
Nov 14 06:35:30 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:35:30 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:35:30 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:35:30 user nova-compute[75354]:   </os>
Nov 14 06:35:30 user nova-compute[75354]:   <features>
Nov 14 06:35:30 user nova-compute[75354]:     <acpi/>
Nov 14 06:35:30 user nova-compute[75354]:     <apic/>
Nov 14 06:35:30 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:35:30 user nova-compute[75354]:   </features>
Nov 14 06:35:30 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:35:30 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:35:30 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:35:30 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:35:30 user nova-compute[75354]:   </clock>
Nov 14 06:35:30 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:35:30 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:35:30 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:35:30 user nova-compute[75354]:   </cpu>
Nov 14 06:35:30 user nova-compute[75354]:   <devices>
Nov 14 06:35:30 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:35:30 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:35:30 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk"/>
Nov 14 06:35:30 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:35:30 user nova-compute[75354]:     </disk>
Nov 14 06:35:30 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:35:30 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:35:30 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 06:35:30 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:35:30 user nova-compute[75354]:       <serial>6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf</serial>
Nov 14 06:35:30 user nova-compute[75354]:     </disk>
Nov 14 06:35:30 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:35:30 user nova-compute[75354]:       <mac address="fa:16:3e:f8:4e:57"/>
Nov 14 06:35:30 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:30 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:35:30 user nova-compute[75354]:       <target dev="tap307913af-88"/>
Nov 14 06:35:30 user nova-compute[75354]:     </interface>
Nov 14 06:35:30 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:35:30 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/console.log" append="off"/>
Nov 14 06:35:30 user nova-compute[75354]:     </serial>
Nov 14 06:35:30 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:35:30 user nova-compute[75354]:     <video>
Nov 14 06:35:30 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:30 user nova-compute[75354]:     </video>
Nov 14 06:35:30 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:35:30 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:35:30 user nova-compute[75354]:     </rng>
Nov 14 06:35:30 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:35:30 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:35:30 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:35:30 user nova-compute[75354]:     </memballoon>
Nov 14 06:35:30 user nova-compute[75354]:   </devices>
Nov 14 06:35:30 user nova-compute[75354]: </domain>
Nov 14 06:35:30 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG os_vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29ed5203-f502-5910-8fb8-178af698d47e', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307913af-88, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap307913af-88, col_values=(('qos', UUID('0feaed0f-8889-4660-bc98-baf1db2aea19')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap307913af-88, col_values=(('external_ids', {'iface-id': '307913af-8833-4c78-8600-a43bbc913f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4e:57', 'vm-uuid': '787b732d-c4cc-4cf1-8069-6a8d0458b3b9'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:30 user nova-compute[75354]: INFO os_vif [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88')
Nov 14 06:35:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:35:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=25.518184661865234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b96beb17-09e1-45a2-8699-8657baa034e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 73aaf228-084d-4d35-acd9-27db3536287f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 616cd639-1e6f-4bed-8cba-7da50d65a4d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:35:30 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-8ad3aba8-a205-4879-a672-12e63d06072e req-59e6abe9-0e5d-4249-bc62-12db714387c0 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8ad3aba8-a205-4879-a672-12e63d06072e req-59e6abe9-0e5d-4249-bc62-12db714387c0 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8ad3aba8-a205-4879-a672-12e63d06072e req-59e6abe9-0e5d-4249-bc62-12db714387c0 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8ad3aba8-a205-4879-a672-12e63d06072e req-59e6abe9-0e5d-4249-bc62-12db714387c0 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-8ad3aba8-a205-4879-a672-12e63d06072e req-59e6abe9-0e5d-4249-bc62-12db714387c0 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:31 user nova-compute[75354]: WARNING nova.compute.manager [req-8ad3aba8-a205-4879-a672-12e63d06072e req-59e6abe9-0e5d-4249-bc62-12db714387c0 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state resized and task_state resize_reverting.
Nov 14 06:35:32 user nova-compute[75354]: INFO nova.compute.manager [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Rescuing
Nov 14 06:35:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG nova.network.neutron [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG nova.network.neutron [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-ad63992e-8d58-4de8-bb45-cce06fd161f5 req-447b3187-052b-4607-9e2f-265c20a88f09 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-unplugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ad63992e-8d58-4de8-bb45-cce06fd161f5 req-447b3187-052b-4607-9e2f-265c20a88f09 service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ad63992e-8d58-4de8-bb45-cce06fd161f5 req-447b3187-052b-4607-9e2f-265c20a88f09 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ad63992e-8d58-4de8-bb45-cce06fd161f5 req-447b3187-052b-4607-9e2f-265c20a88f09 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-ad63992e-8d58-4de8-bb45-cce06fd161f5 req-447b3187-052b-4607-9e2f-265c20a88f09 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-unplugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:32 user nova-compute[75354]: WARNING nova.compute.manager [req-ad63992e-8d58-4de8-bb45-cce06fd161f5 req-447b3187-052b-4607-9e2f-265c20a88f09 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-unplugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state active and task_state rescuing.
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance destroyed successfully.
Nov 14 06:35:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Attempting rescue
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:35:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Creating image(s)
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'trusted_certs' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue" returned: 0 in 0.044s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'migration_context' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.base [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<dce2abf5-a489-4d92-8a91-b3f436c53a50> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Start _get_guest_xml network_info=[{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:9d:d8:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '013c3665-3f76-488b-92b6-f08787e9badf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'resources' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.base [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<dce2abf5-a489-4d92-8a91-b3f436c53a50> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'numa_topology' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.base [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<dce2abf5-a489-4d92-8a91-b3f436c53a50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:35:33 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:33 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'vcpu_model' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.base [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<dce2abf5-a489-4d92-8a91-b3f436c53a50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1517792480',display_name='tempest-ServerRescueNegativeTestJSON-server-1517792480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1517792480',id=14,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:33:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-hbtz4cbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:53Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=dce2abf5-a489-4d92-8a91-b3f436c53a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:9d:d8:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:9d:d8:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'pci_devices' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.objects.base [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<dce2abf5-a489-4d92-8a91-b3f436c53a50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:35:33 user nova-compute[75354]:   <uuid>dce2abf5-a489-4d92-8a91-b3f436c53a50</uuid>
Nov 14 06:35:33 user nova-compute[75354]:   <name>instance-0000000e</name>
Nov 14 06:35:33 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:35:33 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:35:33 user nova-compute[75354]:   <metadata>
Nov 14 06:35:33 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:35:33 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:35:33 user nova-compute[75354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1517792480</nova:name>
Nov 14 06:35:33 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:35:33</nova:creationTime>
Nov 14 06:35:33 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:35:33 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:35:33 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:35:33 user nova-compute[75354]:       <nova:owner>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:user uuid="7f141a1ef1b44b34b09a8f2f88d5af17">tempest-ServerRescueNegativeTestJSON-2059994566-project-member</nova:user>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:project uuid="601a7175bd194f79b4ae31d34f724de4">tempest-ServerRescueNegativeTestJSON-2059994566</nova:project>
Nov 14 06:35:33 user nova-compute[75354]:       </nova:owner>
Nov 14 06:35:33 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:35:33 user nova-compute[75354]:       <nova:ports>
Nov 14 06:35:33 user nova-compute[75354]:         <nova:port uuid="596b67d5-4969-419f-a281-4b5722e48708">
Nov 14 06:35:33 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:35:33 user nova-compute[75354]:         </nova:port>
Nov 14 06:35:33 user nova-compute[75354]:       </nova:ports>
Nov 14 06:35:33 user nova-compute[75354]:     </nova:instance>
Nov 14 06:35:33 user nova-compute[75354]:   </metadata>
Nov 14 06:35:33 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:35:33 user nova-compute[75354]:     <system>
Nov 14 06:35:33 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:35:33 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:35:33 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:35:33 user nova-compute[75354]:       <entry name="serial">dce2abf5-a489-4d92-8a91-b3f436c53a50</entry>
Nov 14 06:35:33 user nova-compute[75354]:       <entry name="uuid">dce2abf5-a489-4d92-8a91-b3f436c53a50</entry>
Nov 14 06:35:33 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:35:33 user nova-compute[75354]:     </system>
Nov 14 06:35:33 user nova-compute[75354]:   </sysinfo>
Nov 14 06:35:33 user nova-compute[75354]:   <os>
Nov 14 06:35:33 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:35:33 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:35:33 user nova-compute[75354]:   </os>
Nov 14 06:35:33 user nova-compute[75354]:   <features>
Nov 14 06:35:33 user nova-compute[75354]:     <acpi/>
Nov 14 06:35:33 user nova-compute[75354]:     <apic/>
Nov 14 06:35:33 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:35:33 user nova-compute[75354]:   </features>
Nov 14 06:35:33 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:35:33 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:35:33 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:35:33 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:35:33 user nova-compute[75354]:   </clock>
Nov 14 06:35:33 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:35:33 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:35:33 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:35:33 user nova-compute[75354]:   </cpu>
Nov 14 06:35:33 user nova-compute[75354]:   <devices>
Nov 14 06:35:33 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:35:33 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:35:33 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue"/>
Nov 14 06:35:33 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:35:33 user nova-compute[75354]:     </disk>
Nov 14 06:35:33 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:35:33 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:35:33 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk"/>
Nov 14 06:35:33 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:35:33 user nova-compute[75354]:     </disk>
Nov 14 06:35:33 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:35:33 user nova-compute[75354]:       <mac address="fa:16:3e:9d:d8:e9"/>
Nov 14 06:35:33 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:33 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:35:33 user nova-compute[75354]:       <target dev="tap596b67d5-49"/>
Nov 14 06:35:33 user nova-compute[75354]:     </interface>
Nov 14 06:35:33 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:35:33 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/console.log" append="off"/>
Nov 14 06:35:33 user nova-compute[75354]:     </serial>
Nov 14 06:35:33 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:35:33 user nova-compute[75354]:     <video>
Nov 14 06:35:33 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:35:33 user nova-compute[75354]:     </video>
Nov 14 06:35:33 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:35:33 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:35:33 user nova-compute[75354]:     </rng>
Nov 14 06:35:33 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:35:33 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:35:33 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:35:33 user nova-compute[75354]:     </memballoon>
Nov 14 06:35:33 user nova-compute[75354]:   </devices>
Nov 14 06:35:33 user nova-compute[75354]: </domain>
Nov 14 06:35:33 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:35:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance destroyed successfully.
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:9d:d8:e9, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:35:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance running successfully.
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] finish_revert_migration finished successfully. {{(pid=75354) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-9dc1f87a-10db-41c0-862c-004810ce58b2 req-25171959-ed05-47b7-9ec5-a475f70a0212 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9dc1f87a-10db-41c0-862c-004810ce58b2 req-25171959-ed05-47b7-9ec5-a475f70a0212 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9dc1f87a-10db-41c0-862c-004810ce58b2 req-25171959-ed05-47b7-9ec5-a475f70a0212 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9dc1f87a-10db-41c0-862c-004810ce58b2 req-25171959-ed05-47b7-9ec5-a475f70a0212 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-9dc1f87a-10db-41c0-862c-004810ce58b2 req-25171959-ed05-47b7-9ec5-a475f70a0212 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:33 user nova-compute[75354]: WARNING nova.compute.manager [req-9dc1f87a-10db-41c0-862c-004810ce58b2 req-25171959-ed05-47b7-9ec5-a475f70a0212 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state resized and task_state resize_reverting.
Nov 14 06:35:34 user nova-compute[75354]: INFO nova.compute.manager [None req-7a751e06-7329-4137-b784-cecb1788aa2b tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance to original state: 'active'
Nov 14 06:35:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-63e7e412-24d0-4e7c-8477-4c218da9cf0a req-9d6d22bd-1569-4624-9f4d-dbd2f6ae42af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63e7e412-24d0-4e7c-8477-4c218da9cf0a req-9d6d22bd-1569-4624-9f4d-dbd2f6ae42af service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63e7e412-24d0-4e7c-8477-4c218da9cf0a req-9d6d22bd-1569-4624-9f4d-dbd2f6ae42af service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63e7e412-24d0-4e7c-8477-4c218da9cf0a req-9d6d22bd-1569-4624-9f4d-dbd2f6ae42af service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-63e7e412-24d0-4e7c-8477-4c218da9cf0a req-9d6d22bd-1569-4624-9f4d-dbd2f6ae42af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:34 user nova-compute[75354]: WARNING nova.compute.manager [req-63e7e412-24d0-4e7c-8477-4c218da9cf0a req-9d6d22bd-1569-4624-9f4d-dbd2f6ae42af service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state active and task_state rescuing.
Nov 14 06:35:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:36 user nova-compute[75354]: INFO nova.compute.manager [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Terminating instance
Nov 14 06:35:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:36 user nova-compute[75354]: WARNING nova.compute.manager [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state active and task_state rescuing.
Nov 14 06:35:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:36 user nova-compute[75354]: WARNING nova.compute.manager [req-b34c782d-3b2c-4877-ab97-1f3ece2c41cb req-662a4a12-66a0-40a2-8f58-f33b53c29142 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state active and task_state rescuing.
Nov 14 06:35:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.compute.manager [None req-380ae2e4-d614-46cd-8d06-462887628a8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-99c34d95-2ffb-4d0a-83e4-537f3b929e8c req-19ee00dd-6737-49b0-9625-a79c69fe6133 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-vif-unplugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99c34d95-2ffb-4d0a-83e4-537f3b929e8c req-19ee00dd-6737-49b0-9625-a79c69fe6133 service nova] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99c34d95-2ffb-4d0a-83e4-537f3b929e8c req-19ee00dd-6737-49b0-9625-a79c69fe6133 service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99c34d95-2ffb-4d0a-83e4-537f3b929e8c req-19ee00dd-6737-49b0-9625-a79c69fe6133 service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-99c34d95-2ffb-4d0a-83e4-537f3b929e8c req-19ee00dd-6737-49b0-9625-a79c69fe6133 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] No waiting events found dispatching network-vif-unplugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-99c34d95-2ffb-4d0a-83e4-537f3b929e8c req-19ee00dd-6737-49b0-9625-a79c69fe6133 service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-vif-unplugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Instance destroyed successfully.
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lazy-loading 'resources' on Instance uuid b96beb17-09e1-45a2-8699-8657baa034e8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268927131',display_name='tempest-VolumesAdminNegativeTest-server-1268927131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268927131',id=4,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGF9RKO05OBECccZ0G2rHDFQJCXUz2b1i+X0bLlUPeRgAO/o/oQ2ylkZ8O3YfL0JLLMaU8pjhMss0rCQnew2p41zXleOKI592AGW7j3Qt/bvVCWuT3hPvwzvxDEsbWmFQ==',key_name='tempest-keypair-2067120629',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:30:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f1f7375b4ed4d649edad03899ab4446',ramdisk_id='',reservation_id='r-i60esprr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1431300602',owner_user_name='tempest-VolumesAdminNegativeTest-1431300602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdace4f11a3f4e95862b8c979e82d7ab',uuid=b96beb17-09e1-45a2-8699-8657baa034e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converting VIF {"id": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "address": "fa:16:3e:d5:66:2e", "network": {"id": "aab8f35e-f807-493f-b428-926719b8abaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1337218954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f1f7375b4ed4d649edad03899ab4446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbfc4596-8f", "ovs_interfaceid": "dbfc4596-8f58-48ea-b4b8-b9452493e3c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG os_vif [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbfc4596-8f, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d682cb9-2016-40c9-9d53-8066669c3e87) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:35:37 user nova-compute[75354]: INFO os_vif [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:66:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbfc4596-8f58-48ea-b4b8-b9452493e3c3,network=Network(aab8f35e-f807-493f-b428-926719b8abaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbfc4596-8f')
Nov 14 06:35:37 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Deleting instance files /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8_del
Nov 14 06:35:37 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Deletion of /opt/stack/data/nova/instances/b96beb17-09e1-45a2-8699-8657baa034e8_del complete
Nov 14 06:35:37 user nova-compute[75354]: INFO nova.compute.manager [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 06:35:37 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:35:37 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Skipping network cache update for instance because it is being deleted. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:38 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Took 0.91 seconds to deallocate network for instance.
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [{"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-787b732d-c4cc-4cf1-8069-6a8d0458b3b9" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:35:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-3b87fb75-ae95-4755-8c55-59f2e5f1133b req-4bc2c720-34b8-474c-b794-310418cc9c4d service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-vif-deleted-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:39 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Deleted allocations for instance b96beb17-09e1-45a2-8699-8657baa034e8
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e446f0f3-754f-40ed-9ddb-e7dd0299b2b8 tempest-VolumesAdminNegativeTest-1431300602 tempest-VolumesAdminNegativeTest-1431300602-project-member] Lock "b96beb17-09e1-45a2-8699-8657baa034e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-35c8007c-3e49-47c7-8dab-f23d06438a7f req-dfbd7650-e976-44fe-ab26-fd09d956c52f service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received event network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-35c8007c-3e49-47c7-8dab-f23d06438a7f req-dfbd7650-e976-44fe-ab26-fd09d956c52f service nova] Acquiring lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-35c8007c-3e49-47c7-8dab-f23d06438a7f req-dfbd7650-e976-44fe-ab26-fd09d956c52f service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-35c8007c-3e49-47c7-8dab-f23d06438a7f req-dfbd7650-e976-44fe-ab26-fd09d956c52f service nova] Lock "b96beb17-09e1-45a2-8699-8657baa034e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-35c8007c-3e49-47c7-8dab-f23d06438a7f req-dfbd7650-e976-44fe-ab26-fd09d956c52f service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] No waiting events found dispatching network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:39 user nova-compute[75354]: WARNING nova.compute.manager [req-35c8007c-3e49-47c7-8dab-f23d06438a7f req-dfbd7650-e976-44fe-ab26-fd09d956c52f service nova] [instance: b96beb17-09e1-45a2-8699-8657baa034e8] Received unexpected event network-vif-plugged-dbfc4596-8f58-48ea-b4b8-b9452493e3c3 for instance with vm_state deleted and task_state None.
Nov 14 06:35:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-changed-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Refreshing instance network info cache due to event network-changed-1908e79c-265a-4dfd-91ad-ab4e87986ed9. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] Acquiring lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] Acquired lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Refreshing network info cache for port 1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updated VIF entry in instance network info cache for port 1908e79c-265a-4dfd-91ad-ab4e87986ed9. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updating instance_info_cache with network_info: [{"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fa7a2279-809f-48d2-85d2-c6f505a0e1c1 req-ba04aab6-eefb-4aea-b503-e1361625e3e6 service nova] Releasing lock "refresh_cache-9ad47fd2-5e38-4ef6-a007-374bb9a21df7" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:35:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG nova.objects.instance [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lazy-loading 'flavor' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:43 user nova-compute[75354]: INFO nova.compute.manager [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Attaching volume e640bb67-f29a-4668-9b90-052fa433342b to /dev/vdb
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.utils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1869daba-b4fa-415e-a4be-591b25a54a92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6808fe5-711c-4b5b-8ec4-b21ae48ed1ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef0dee-d966-4749-babe-23a1f4db9fb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2d340-689a-47d5-a2c3-73614e8cf63e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:35:43 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19525705-95a7-4892-aa1f-c16fb2afca92]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.utils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updating existing volume attachment record: 97441bc3-c370-4886-ba48-fd9f3fe023b7 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:35:43 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd is timed out.
Nov 14 06:35:43 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully detached device vdb from instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd from the live domain config.
Nov 14 06:35:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXiBztOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07d42d2-506d-4f4b-b2ea-b0c9bbf58037]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:35:44 user nova-compute[75354]: No targets found.
Nov 14 06:35:44 user nova-compute[75354]: iSNS:
Nov 14 06:35:44 user nova-compute[75354]: No targets found.
Nov 14 06:35:44 user nova-compute[75354]: STATIC:
Nov 14 06:35:44 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:35:44 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:35:44 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:35:44 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241
Nov 14 06:35:44 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:35:44 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:35:44 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:35:44 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:35:44 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:35:44 user nova-compute[75354]: FIRMWARE:
Nov 14 06:35:44 user nova-compute[75354]: No targets found.
Nov 14 06:35:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:35:44 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:35:44 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c094404-b4f3-4916-85f3-ddfdd9d304f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f0f15-6db7-4f8d-ad7f-77319e284db1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:44 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:44 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 (non-flash)
Nov 14 06:35:44 user nova-compute[75354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:44 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074464c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[44095c5c-7340-42b4-bcae-62d5d9346cbe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8659cea-0f22-4735-b979-8076c0229b06]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb34ba-5c4d-440d-977b-8158f18f8447]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee15347-e5d4-46a3-b7dc-6f0b8a6298b1]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ed618-ebdb-4d4c-8559-eb69c221dde2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f24a5-0c34-40cb-8bc1-1343274d80a7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260]
Nov 14 06:35:44 user nova-compute[75354]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241, portal: 172.16.0.220,3260] successful.
Nov 14 06:35:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e4ddb08-ad6c-4d7b-952a-5c9793268241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[710fcbf9-755d-4061-8d2e-16a6dbdfba7d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== disconnect_volume: return (299ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:35:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e8f37642-b054-4856-87f4-c23321bad605 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75354) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d05a7020-7f14-45aa-8129-50eddd9ac83f req-5bb97e59-f463-4615-ad05-d89fe6707cba service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d05a7020-7f14-45aa-8129-50eddd9ac83f req-5bb97e59-f463-4615-ad05-d89fe6707cba service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d05a7020-7f14-45aa-8129-50eddd9ac83f req-5bb97e59-f463-4615-ad05-d89fe6707cba service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d05a7020-7f14-45aa-8129-50eddd9ac83f req-5bb97e59-f463-4615-ad05-d89fe6707cba service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d05a7020-7f14-45aa-8129-50eddd9ac83f req-5bb97e59-f463-4615-ad05-d89fe6707cba service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:46 user nova-compute[75354]: WARNING nova.compute.manager [req-d05a7020-7f14-45aa-8129-50eddd9ac83f req-5bb97e59-f463-4615-ad05-d89fe6707cba service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state powering-off.
Nov 14 06:35:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance destroyed successfully.
Nov 14 06:35:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:35:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c4849b87-1ff2-420d-b878-52dd4dd38075 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.887s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:48 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94151728-ac1f-4e2e-988c-aebe5c571a46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:35:48 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[683366fa-e066-466c-9961-3a46206f297d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b] added
Nov 14 06:35:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0893b7e3-e2b3-4250-aff2-ced0f7c87df3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9034ef03-ce33-4333-aa2c-2a476d3aea5c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InpolcmZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InpolcmZ" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7646f02-7039-4e8e-b12d-fb44a194c3c7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'InpolcmZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a632c-48d1-455c-abbb-cc3c5f37390a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1177b-5252-40c7-ad93-cb7e83c1b8e2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:48 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:48 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a8936-50bd-4e01-a69f-e286ffb35b85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]
Nov 14 06:35:48 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.
Nov 14 06:35:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e388a1da-b4e9-491b-96d3-b187b172a50e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e1128-a21c-4775-9d8a-158622f6e24a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:48 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:48 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:35:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:48 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:48 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:35:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03ec61-8eab-4f35-ae4a-90383a44d593]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b0fc20b-66ad-4e8d-9062-d8af3fb3320a req-853fd5ef-bde5-41a9-a164-3fa7d2e02175 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b0fc20b-66ad-4e8d-9062-d8af3fb3320a req-853fd5ef-bde5-41a9-a164-3fa7d2e02175 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b0fc20b-66ad-4e8d-9062-d8af3fb3320a req-853fd5ef-bde5-41a9-a164-3fa7d2e02175 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b0fc20b-66ad-4e8d-9062-d8af3fb3320a req-853fd5ef-bde5-41a9-a164-3fa7d2e02175 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b0fc20b-66ad-4e8d-9062-d8af3fb3320a req-853fd5ef-bde5-41a9-a164-3fa7d2e02175 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:35:48 user nova-compute[75354]: WARNING nova.compute.manager [req-1b0fc20b-66ad-4e8d-9062-d8af3fb3320a req-853fd5ef-bde5-41a9-a164-3fa7d2e02175 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state stopped and task_state None.
Nov 14 06:35:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23836383234383130', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836383234383130', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG nova.objects.instance [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lazy-loading 'flavor' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:35:49 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:35:49 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:35:49 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:35:49 user nova-compute[75354]:   <serial>e640bb67-f29a-4668-9b90-052fa433342b</serial>
Nov 14 06:35:49 user nova-compute[75354]: </disk>
Nov 14 06:35:49 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] No VIF found with MAC fa:16:3e:f2:f2:09, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:35:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-97677543-b347-43d3-8ffa-1b28a6a1dbb3 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.369s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG os_brick.utils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e95e16-713d-42ff-ae86-89b3a2902c99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008da1d-a893-4d12-8bcf-86826da0f9a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[287742a7-4ae1-4838-8bff-fd2827bef871]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ebc1d0-f3f3-4f60-aa01-9a8d6efa32e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:35:50 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:35:50 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[25706f05-5c25-4a0d-ad60-df6a2008b61a]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:35:50 user nova-compute[75354]: DEBUG os_brick.utils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:50 user nova-compute[75354]: INFO nova.compute.manager [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Swapping volume e640bb67-f29a-4668-9b90-052fa433342b for d616b8cc-63a0-40ee-80a7-47fbc50dc875
Nov 14 06:35:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONiIdvaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875', 'serial': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e640bb67-f29a-4668-9b90-052fa433342b', 'serial'} {{(pid=75354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONiIdvaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:35:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:35:54 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec03f24-3c37-4bca-8cb7-dc6cec9f759e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:35:54 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdba620-a93c-4037-ba78-31e3042b2d6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875] added
Nov 14 06:35:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8268d-1562-4698-b82e-752b5362d762]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace59d7-de00-4edc-afa2-a6dcb81c2096]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONiIdvaV {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONiIdvaV" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26cba33-01b9-4b75-833c-7a402094bdc0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONiIdvaV'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[214e75c1-b41c-4b48-b27a-055a8ae467e5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf59951-cd39-4873-8931-5ab5590c997d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:35:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:35:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8318c3-caea-4eab-bd24-ec8ef1747209]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260]
Nov 14 06:35:55 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260] successful.
Nov 14 06:35:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa9656c-a570-48b7-b141-a862ddcc0893]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d7abe0-1155-4708-8a1f-8d43ac6335c4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:35:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:35:55 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:35:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e60366-b687-4045-bde1-8835e464000c]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:35:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONiIdvaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:35:56 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:35:56 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26238353563393930', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:35:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238353563393930', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:35:56 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lazy-loading 'flavor' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:35:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:35:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 186646528 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:35:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 377487360 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:35:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:35:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 535822336 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:35:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 717225984 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:35:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:35:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 1061158912 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:36:00 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[47918f01-8d30-4d19-b9c1-eeba1228993f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:36:00 user nova-compute[75354]: No targets found.
Nov 14 06:36:00 user nova-compute[75354]: iSNS:
Nov 14 06:36:00 user nova-compute[75354]: No targets found.
Nov 14 06:36:00 user nova-compute[75354]: STATIC:
Nov 14 06:36:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:36:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b
Nov 14 06:36:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875
Nov 14 06:36:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:00 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:36:00 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:00 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:00 user nova-compute[75354]: FIRMWARE:
Nov 14 06:36:00 user nova-compute[75354]: No targets found.
Nov 14 06:36:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:36:00 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:36:00 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce2efd1-8b02-4543-88ea-5464c4bb62b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[91792eb6-7f95-4743-915b-910ac4b60c9b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:00 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:00 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:00 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:00 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:00 user nova-compute[75354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:00 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80742157e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c884447f-262e-4f54-b728-ddb8e5bad10e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58326f-9e0f-4ac5-866e-dfb4f62676b8]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4941911-1b6f-4cb7-a372-82b9b36c4bd1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d22da18-9461-4fdc-943f-d59570774c41]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a1201-72ee-4ea5-8247-5df0e51e6dc6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e00df34-c1e9-4093-8768-122a4b28afa1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]
Nov 14 06:36:00 user nova-compute[75354]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.
Nov 14 06:36:00 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[517919db-5be7-483e-aad1-266695a4dadb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] <== disconnect_volume: return (311ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONiIdvaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875', 'serial'} {{(pid=75354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 06:36:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] swap_volume: removing Cinder connection for volume e640bb67-f29a-4668-9b90-052fa433342b {{(pid=75354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 06:36:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] swap_volume: Updating volume e640bb67-f29a-4668-9b90-052fa433342b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ONiIdvaV", "auth_password": "Nm5BU7pWRauAT1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "d616b8cc-63a0-40ee-80a7-47fbc50dc875"}, "status": "reserved", "instance": "9ad47fd2-5e38-4ef6-a007-374bb9a21df7", "attached_at": "", "detached_at": "", "volume_id": "d616b8cc-63a0-40ee-80a7-47fbc50dc875", "serial": "d616b8cc-63a0-40ee-80a7-47fbc50dc875"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875', 'no_device': None, 'attachment_id': '4db62bc5-1a4c-4d5c-9ba0-642f975f627e'} {{(pid=75354) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 06:36:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6911c975-4f81-4c6b-b0ca-38c477675ecc tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.810s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG os_brick.utils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05004a54-d0e9-43bc-958d-ebbf626d5326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c8df2-5773-4f39-9476-09c65d490cdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed5d216-cf20-4476-ab19-4b49189a6cba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff6a0da-87a2-4fc4-8e65-0bb055abee0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:36:02 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:36:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d36fb-5ae9-41e8-9cbf-20f73b0b75bf]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:36:02 user nova-compute[75354]: DEBUG os_brick.utils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:36:03 user nova-compute[75354]: INFO nova.compute.manager [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Swapping volume d616b8cc-63a0-40ee-80a7-47fbc50dc875 for e640bb67-f29a-4668-9b90-052fa433342b
Nov 14 06:36:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 2b2f22af-1a41-4747-9a16-561e260d5f63 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "73aaf228-084d-4d35-acd9-27db3536287f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "73aaf228-084d-4d35-acd9-27db3536287f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e640bb67-f29a-4668-9b90-052fa433342b', 'serial': 'e640bb67-f29a-4668-9b90-052fa433342b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONiIdvaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875'}, 'status': 'reserved', 'instance': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875', 'serial'} {{(pid=75354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:36:07 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:36:07 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:36:07 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcb18b7-8fb0-4858-b15d-30df876e6aab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:36:07 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5589487-2084-43df-9f84-6d2d23910e30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b] added
Nov 14 06:36:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[618aa358-0178-4409-a77d-f36334e1dce8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95ac9b-d7b2-48fa-adcb-1e2dc7279f78]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InpolcmZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InpolcmZ" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9c9c9-b2f5-4ac8-83e5-9469817e2ab2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'InpolcmZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1156eefb-e387-4bb8-808f-1af069a95e63]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bad37d-f228-4157-8cd1-ed0a58f5164c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd3eae-7ef6-4fe5-85a2-fa28ecba9454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]
Nov 14 06:36:07 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.
Nov 14 06:36:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad93c82-e0e4-4424-b845-a81d40cfda37]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fb2cec-2e55-4ef3-90a4-ca133daee96e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:07 user nova-compute[75354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0502d81-71f6-4ced-a6ee-5346d9650d39]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:36:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23836383234383130', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836383234383130', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lazy-loading 'flavor' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 190840832 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 344981504 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 489684992 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 639631360 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 813694976 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 986710016 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONiIdvaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'd616b8cc-63a0-40ee-80a7-47fbc50dc875'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:36:12 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f47065d-c97f-4fdb-ae5d-acbe074f45ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:36:12 user nova-compute[75354]: No targets found.
Nov 14 06:36:12 user nova-compute[75354]: iSNS:
Nov 14 06:36:12 user nova-compute[75354]: No targets found.
Nov 14 06:36:12 user nova-compute[75354]: STATIC:
Nov 14 06:36:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:36:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b
Nov 14 06:36:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875
Nov 14 06:36:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:36:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:12 user nova-compute[75354]: FIRMWARE:
Nov 14 06:36:12 user nova-compute[75354]: No targets found.
Nov 14 06:36:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:36:12 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:36:12 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13950b-e7aa-49ca-b7fe-97efe4bbb101]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b0e3f8-e020-4040-957d-72db60e4adae]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:12 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:12 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:12 user nova-compute[75354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:12 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:12 user nova-compute[75354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 (non-flash)
Nov 14 06:36:12 user nova-compute[75354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074466680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d75aae2-8360-412d-854d-10118a2c4f7c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b351efc-533a-453f-bb9d-021805ed2dc1]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d312428d-0be7-4b48-8e1c-05ea2eb9258a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[420711bc-10ea-467a-9f05-038ddf7fe2ad]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a3189a-edfe-4597-8b66-e94fbf850ea8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671654b-136c-4073-b60b-35afd9a87345]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260]
Nov 14 06:36:12 user nova-compute[75354]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875, portal: 172.16.0.220,3260] successful.
Nov 14 06:36:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d616b8cc-63a0-40ee-80a7-47fbc50dc875 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d81706d-581c-43a7-b8df-378477c1dd35]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] <== disconnect_volume: return (303ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9ad47fd2-5e38-4ef6-a007-374bb9a21df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e640bb67-f29a-4668-9b90-052fa433342b', 'serial'} {{(pid=75354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 06:36:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] swap_volume: removing Cinder connection for volume d616b8cc-63a0-40ee-80a7-47fbc50dc875 {{(pid=75354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 06:36:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] swap_volume: Updating volume d616b8cc-63a0-40ee-80a7-47fbc50dc875 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "InpolcmZ", "auth_password": "K8Sp4YN9OJjgUT", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "e640bb67-f29a-4668-9b90-052fa433342b"}, "status": "reserved", "instance": "9ad47fd2-5e38-4ef6-a007-374bb9a21df7", "attached_at": "", "detached_at": "", "volume_id": "e640bb67-f29a-4668-9b90-052fa433342b", "serial": "e640bb67-f29a-4668-9b90-052fa433342b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e640bb67-f29a-4668-9b90-052fa433342b', 'no_device': None, 'attachment_id': '86ef582a-70f2-4599-b4af-a9a67f8f65f3'} {{(pid=75354) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 06:36:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6cba848c-6ae6-4c04-9f6d-db9f12462dac tempest-TestVolumeSwap-626055183 tempest-TestVolumeSwap-626055183-project-admin] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.893s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.195s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:14 user nova-compute[75354]: INFO nova.compute.manager [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Detaching volume e640bb67-f29a-4668-9b90-052fa433342b
Nov 14 06:36:14 user nova-compute[75354]: INFO nova.virt.block_device [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Attempting to driver detach volume e640bb67-f29a-4668-9b90-052fa433342b from mountpoint /dev/vdb
Nov 14 06:36:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Attempting to detach device vdb from instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:36:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:36:14 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:36:14 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:36:14 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:36:14 user nova-compute[75354]:   <serial>e640bb67-f29a-4668-9b90-052fa433342b</serial>
Nov 14 06:36:14 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:36:14 user nova-compute[75354]: </disk>
Nov 14 06:36:14 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:36:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Successfully detached device vdb from instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 from the persistent domain config.
Nov 14 06:36:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:36:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:36:14 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:36:14 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:36:14 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:36:14 user nova-compute[75354]:   <serial>e640bb67-f29a-4668-9b90-052fa433342b</serial>
Nov 14 06:36:14 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:36:14 user nova-compute[75354]: </disk>
Nov 14 06:36:14 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:36:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:36:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:36:16 user nova-compute[75354]: INFO nova.compute.manager [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] instance snapshotting
Nov 14 06:36:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Beginning live snapshot process
Nov 14 06:36:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.165s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1y3i81zw/096786f7a8ef4031b00bc9da69b88964.delta 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1y3i81zw/096786f7a8ef4031b00bc9da69b88964.delta 1073741824" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 06:36:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 06:36:18 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:36:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1y3i81zw/096786f7a8ef4031b00bc9da69b88964.delta /opt/stack/data/nova/instances/snapshots/tmp1y3i81zw/096786f7a8ef4031b00bc9da69b88964 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1y3i81zw/096786f7a8ef4031b00bc9da69b88964.delta /opt/stack/data/nova/instances/snapshots/tmp1y3i81zw/096786f7a8ef4031b00bc9da69b88964" returned: 0 in 0.403s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Snapshot extracted, beginning image upload
Nov 14 06:36:22 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Snapshot image upload complete
Nov 14 06:36:22 user nova-compute[75354]: INFO nova.compute.manager [None req-44b55f9c-e6e2-400e-ab3c-8fdbab44585a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Took 5.73 seconds to snapshot the instance on the hypervisor.
Nov 14 06:36:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing instance network info cache due to event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:36:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:23 user nova-compute[75354]: DEBUG nova.network.neutron [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:36:24 user nova-compute[75354]: DEBUG nova.network.neutron [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updated VIF entry in instance network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:36:24 user nova-compute[75354]: DEBUG nova.network.neutron [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99a5bb69-cc6e-4490-ab97-f001b1305bc0 req-c64a076a-8dec-4c4d-8580-a1b47fa8bfe2 service nova] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:26 user nova-compute[75354]: INFO nova.compute.manager [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Shelving
Nov 14 06:36:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-50250372-2824-46ab-86b4-3a1ac3bdceea req-9517943b-264c-4d64-a7e3-2da928bb3302 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-unplugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-50250372-2824-46ab-86b4-3a1ac3bdceea req-9517943b-264c-4d64-a7e3-2da928bb3302 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-50250372-2824-46ab-86b4-3a1ac3bdceea req-9517943b-264c-4d64-a7e3-2da928bb3302 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-50250372-2824-46ab-86b4-3a1ac3bdceea req-9517943b-264c-4d64-a7e3-2da928bb3302 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-50250372-2824-46ab-86b4-3a1ac3bdceea req-9517943b-264c-4d64-a7e3-2da928bb3302 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-unplugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:36:26 user nova-compute[75354]: WARNING nova.compute.manager [req-50250372-2824-46ab-86b4-3a1ac3bdceea req-9517943b-264c-4d64-a7e3-2da928bb3302 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-unplugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state active and task_state shelving.
Nov 14 06:36:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:27 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance destroyed successfully.
Nov 14 06:36:27 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Beginning cold snapshot process
Nov 14 06:36:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:27 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:36:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk /opt/stack/data/nova/instances/snapshots/tmpu_1vn8rd/da891d36ae4943ec973486cb30c682c7 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk /opt/stack/data/nova/instances/snapshots/tmpu_1vn8rd/da891d36ae4943ec973486cb30c682c7" returned: 0 in 0.457s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Snapshot extracted, beginning image upload
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-88043f16-d4c6-4edf-bf57-2166a6a41062 req-07250406-c42e-4f13-96b4-183a22275f6e service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-88043f16-d4c6-4edf-bf57-2166a6a41062 req-07250406-c42e-4f13-96b4-183a22275f6e service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-88043f16-d4c6-4edf-bf57-2166a6a41062 req-07250406-c42e-4f13-96b4-183a22275f6e service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-88043f16-d4c6-4edf-bf57-2166a6a41062 req-07250406-c42e-4f13-96b4-183a22275f6e service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-88043f16-d4c6-4edf-bf57-2166a6a41062 req-07250406-c42e-4f13-96b4-183a22275f6e service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:36:28 user nova-compute[75354]: WARNING nova.compute.manager [req-88043f16-d4c6-4edf-bf57-2166a6a41062 req-07250406-c42e-4f13-96b4-183a22275f6e service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Snapshot image upload complete
Nov 14 06:36:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:36:30 user nova-compute[75354]: INFO nova.compute.manager [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Shelve offloading
Nov 14 06:36:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance destroyed successfully.
Nov 14 06:36:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing instance network info cache due to event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:36:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:36:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7834MB free_disk=25.463050842285156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance destroyed successfully.
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'resources' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1340763703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1340763703',id=17,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmsF02ZEXdbuk9QCs7SA/txSVRgC3Oz0qX28z3E+1APothIULTiSmML0bF6mbyk32onsnJxKlsAmJGE2meQznKvtpPz0DI2w9hD7BN5iYM6qZPE2ASG0nBwBiy1nlRxFA==',key_name='tempest-keypair-1770135778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-yfqwzrrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member',shelved_at='2023-11-14T06:36:30.657076',shelved_host='user',shelved_image_id='ce68234c-b1a2-445a-ba7b-c592b59cce2f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:36:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=73aaf228-084d-4d35-acd9-27db3536287f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG os_vif [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4861783a-e4, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=820ad0ed-bc91-4541-af3a-a649c8f4b690) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:32 user nova-compute[75354]: INFO os_vif [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4')
Nov 14 06:36:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Deleting instance files /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f_del
Nov 14 06:36:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Deletion of /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f_del complete
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 73aaf228-084d-4d35-acd9-27db3536287f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 616cd639-1e6f-4bed-8cba-7da50d65a4d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:36:32 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Deleted allocations for instance 73aaf228-084d-4d35-acd9-27db3536287f
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updated VIF entry in instance network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4861783a-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0cc1493d-7494-4685-8f8c-d5f3eb7717dd req-a20e0168-f6ec-4bcb-ad6c-b25704bb92c9 service nova] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:36:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.828s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.376s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'numa_topology' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG nova.objects.base [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<73aaf228-084d-4d35-acd9-27db3536287f> lazy-loaded attributes: resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c2552c0d-0d32-4436-8fd0-ca0a8516db8f tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.722s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:35 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 is timed out.
Nov 14 06:36:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Successfully detached device vdb from instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 from the live domain config.
Nov 14 06:36:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InpolcmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'e640bb67-f29a-4668-9b90-052fa433342b'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:36:35 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50fa20b-d27b-4aa4-986e-f3189e150fb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:36:35 user nova-compute[75354]: No targets found.
Nov 14 06:36:35 user nova-compute[75354]: iSNS:
Nov 14 06:36:35 user nova-compute[75354]: No targets found.
Nov 14 06:36:35 user nova-compute[75354]: STATIC:
Nov 14 06:36:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:36:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b
Nov 14 06:36:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:36:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:35 user nova-compute[75354]: FIRMWARE:
Nov 14 06:36:35 user nova-compute[75354]: No targets found.
Nov 14 06:36:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:36:35 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:36:35 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e471dc-9799-4a2f-a6eb-3aaa56b69af0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbeac53-bb72-4348-92a6-354bae85dd62]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:35 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:35 user nova-compute[75354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:35 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:35 user nova-compute[75354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b (non-flash)
Nov 14 06:36:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80742155a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2174e3-db14-4941-8f05-f02618154b80]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[69edebb7-fa5f-454f-807b-b1442938c412]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[136795a6-378f-4c8d-93d1-8502f1477900]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f9a66-ef2d-4ccf-a907-769fb440b501]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b83fa-bc8f-4854-bdf8-9780569e1e68]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[078994f3-4710-4c11-abba-3d8cf298ed29]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260]
Nov 14 06:36:35 user nova-compute[75354]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b, portal: 172.16.0.220,3260] successful.
Nov 14 06:36:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e640bb67-f29a-4668-9b90-052fa433342b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f6930d-e973-4a3b-8b6f-054dba333ae2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] <== disconnect_volume: return (315ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:36:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lazy-loading 'flavor' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98befd15-4265-4962-93c2-68e4cfb3999b tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.613s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:36:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:36:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:36:45 user nova-compute[75354]: INFO nova.compute.claims [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Claim successful on node user
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:36:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:36:45 user nova-compute[75354]: DEBUG nova.policy [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4616257fc4344844a8a7913673ae0a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85018ee44225437ab1d8b96c5fa4c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:36:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Creating image(s)
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "/opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "/opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk 1073741824" returned: 0 in 0.047s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Successfully created port: a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Cannot resize image /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Ensure instance console log exists: /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Successfully updated port: a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquired lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-changed-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Refreshing instance network info cache due to event network-changed-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] Acquiring lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Releasing lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Instance network_info: |[{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] Acquired lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Refreshing network info cache for port a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Start _get_guest_xml network_info=[{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:36:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:36:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-391938631',display_name='tempest-ServerActionsTestOtherA-server-391938631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-391938631',id=20,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-sc7p8526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=3e182ade-8d18-4fd0-a197-e4ea6d655e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e182ade-8d18-4fd0-a197-e4ea6d655e2d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:36:47 user nova-compute[75354]:   <uuid>3e182ade-8d18-4fd0-a197-e4ea6d655e2d</uuid>
Nov 14 06:36:47 user nova-compute[75354]:   <name>instance-00000014</name>
Nov 14 06:36:47 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:36:47 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:36:47 user nova-compute[75354]:   <metadata>
Nov 14 06:36:47 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:36:47 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:36:47 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherA-server-391938631</nova:name>
Nov 14 06:36:47 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:36:47</nova:creationTime>
Nov 14 06:36:47 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:36:47 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:36:47 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:36:47 user nova-compute[75354]:       <nova:owner>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:user uuid="4616257fc4344844a8a7913673ae0a6a">tempest-ServerActionsTestOtherA-834998162-project-member</nova:user>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:project uuid="85018ee44225437ab1d8b96c5fa4c408">tempest-ServerActionsTestOtherA-834998162</nova:project>
Nov 14 06:36:47 user nova-compute[75354]:       </nova:owner>
Nov 14 06:36:47 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:36:47 user nova-compute[75354]:       <nova:ports>
Nov 14 06:36:47 user nova-compute[75354]:         <nova:port uuid="a3cd5c83-b585-4d06-9990-c2d4e9d1b96c">
Nov 14 06:36:47 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 06:36:47 user nova-compute[75354]:         </nova:port>
Nov 14 06:36:47 user nova-compute[75354]:       </nova:ports>
Nov 14 06:36:47 user nova-compute[75354]:     </nova:instance>
Nov 14 06:36:47 user nova-compute[75354]:   </metadata>
Nov 14 06:36:47 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:36:47 user nova-compute[75354]:     <system>
Nov 14 06:36:47 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:36:47 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:36:47 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:36:47 user nova-compute[75354]:       <entry name="serial">3e182ade-8d18-4fd0-a197-e4ea6d655e2d</entry>
Nov 14 06:36:47 user nova-compute[75354]:       <entry name="uuid">3e182ade-8d18-4fd0-a197-e4ea6d655e2d</entry>
Nov 14 06:36:47 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:36:47 user nova-compute[75354]:     </system>
Nov 14 06:36:47 user nova-compute[75354]:   </sysinfo>
Nov 14 06:36:47 user nova-compute[75354]:   <os>
Nov 14 06:36:47 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:36:47 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:36:47 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:36:47 user nova-compute[75354]:   </os>
Nov 14 06:36:47 user nova-compute[75354]:   <features>
Nov 14 06:36:47 user nova-compute[75354]:     <acpi/>
Nov 14 06:36:47 user nova-compute[75354]:     <apic/>
Nov 14 06:36:47 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:36:47 user nova-compute[75354]:   </features>
Nov 14 06:36:47 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:36:47 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:36:47 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:36:47 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:36:47 user nova-compute[75354]:   </clock>
Nov 14 06:36:47 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:36:47 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:36:47 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:36:47 user nova-compute[75354]:   </cpu>
Nov 14 06:36:47 user nova-compute[75354]:   <devices>
Nov 14 06:36:47 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:36:47 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:36:47 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk"/>
Nov 14 06:36:47 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:36:47 user nova-compute[75354]:     </disk>
Nov 14 06:36:47 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:36:47 user nova-compute[75354]:       <mac address="fa:16:3e:66:4a:8e"/>
Nov 14 06:36:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:36:47 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:36:47 user nova-compute[75354]:       <target dev="tapa3cd5c83-b5"/>
Nov 14 06:36:47 user nova-compute[75354]:     </interface>
Nov 14 06:36:47 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:36:47 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/console.log" append="off"/>
Nov 14 06:36:47 user nova-compute[75354]:     </serial>
Nov 14 06:36:47 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:36:47 user nova-compute[75354]:     <video>
Nov 14 06:36:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:36:47 user nova-compute[75354]:     </video>
Nov 14 06:36:47 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:36:47 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:36:47 user nova-compute[75354]:     </rng>
Nov 14 06:36:47 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:36:47 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:36:47 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:36:47 user nova-compute[75354]:     </memballoon>
Nov 14 06:36:47 user nova-compute[75354]:   </devices>
Nov 14 06:36:47 user nova-compute[75354]: </domain>
Nov 14 06:36:47 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-391938631',display_name='tempest-ServerActionsTestOtherA-server-391938631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-391938631',id=20,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-sc7p8526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=3e182ade-8d18-4fd0-a197-e4ea6d655e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG os_vif [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7daf4b74-c933-518f-9695-11d59fe82e69', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3cd5c83-b5, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3cd5c83-b5, col_values=(('qos', UUID('4d77767c-66b8-4fc0-a22a-f5ff3f99e3cb')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3cd5c83-b5, col_values=(('external_ids', {'iface-id': 'a3cd5c83-b585-4d06-9990-c2d4e9d1b96c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:4a:8e', 'vm-uuid': '3e182ade-8d18-4fd0-a197-e4ea6d655e2d'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:47 user nova-compute[75354]: INFO os_vif [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5')
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:36:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No VIF found with MAC fa:16:3e:66:4a:8e, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing instance network info cache due to event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updated VIF entry in instance network info cache for port a3cd5c83-b585-4d06-9990-c2d4e9d1b96c. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a9f03dde-8973-4f07-a3bc-aa3f706be1f3 req-82007e3b-5e97-4596-b8e7-5b9299f07865 service nova] Releasing lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:48 user nova-compute[75354]: INFO nova.compute.manager [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Shelve offloading
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updated VIF entry in instance network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b9457aa6-fcad-4d7c-a4c9-d2ef4a9ae5c7 req-148bd3e1-f0f8-42ce-aaee-2914a4812e51 service nova] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-1731b8a9-e60b-4357-8f24-3d0d85353427 req-f4799ec5-f989-4299-b685-ddc5cce30cb5 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-unplugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1731b8a9-e60b-4357-8f24-3d0d85353427 req-f4799ec5-f989-4299-b685-ddc5cce30cb5 service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1731b8a9-e60b-4357-8f24-3d0d85353427 req-f4799ec5-f989-4299-b685-ddc5cce30cb5 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1731b8a9-e60b-4357-8f24-3d0d85353427 req-f4799ec5-f989-4299-b685-ddc5cce30cb5 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-1731b8a9-e60b-4357-8f24-3d0d85353427 req-f4799ec5-f989-4299-b685-ddc5cce30cb5 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-unplugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:36:49 user nova-compute[75354]: WARNING nova.compute.manager [req-1731b8a9-e60b-4357-8f24-3d0d85353427 req-f4799ec5-f989-4299-b685-ddc5cce30cb5 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-unplugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state active and task_state shelving.
Nov 14 06:36:49 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance destroyed successfully.
Nov 14 06:36:49 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:36:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing instance network info cache due to event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG nova.network.neutron [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updated VIF entry in instance network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b7c30559-b6f4-471b-bc2d-8901e6a37151 req-077ba742-9a5f-4b38-94d5-256c5cd844b8 service nova] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:36:51 user nova-compute[75354]: INFO nova.compute.manager [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] instance snapshotting
Nov 14 06:36:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Beginning live snapshot process
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:36:51 user nova-compute[75354]: WARNING nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state active and task_state shelving.
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:36:51 user nova-compute[75354]: WARNING nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received unexpected event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with vm_state building and task_state spawning.
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:36:51 user nova-compute[75354]: WARNING nova.compute.manager [req-55d0b44e-024c-493c-ba65-8d658441f76e req-aaf5cbd9-c5f7-4f7b-81b4-a469cdb2697e service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received unexpected event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with vm_state building and task_state spawning.
Nov 14 06:36:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance destroyed successfully.
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'resources' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2003753906',display_name='tempest-TestShelveInstance-server-2003753906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2003753906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+xkObWm0gP6pbiax4KJmPMne8Cjeb+Ks9EthgdyaDozYtxbVfp17rzTIU/i2zP6ul08alPIhgqvZeBPR4hOTQy/3lBA5dtT2s4aJNMg5U4BtVFfohCoMRmivNTMlfT8g==',key_name='tempest-TestShelveInstance-578191332',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:35:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1cd9f605474fe8a451637996110491',ramdisk_id='',reservation_id='r-0eh2op4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1170608310',owner_user_name='tempest-TestShelveInstance-1170608310-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:07Z,user_data=None,user_id='61fe146c06734be7a7039cb754015019',uuid=616cd639-1e6f-4bed-8cba-7da50d65a4d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converting VIF {"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_vif [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing instance network info cache due to event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap889d4a14-a0, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42afe3c7-b3c6-4a37-a42e-18481bffdac5) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:51 user nova-compute[75354]: INFO os_vif [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0')
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:36:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Instance spawned successfully.
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef0ea92-6d74-4213-a843-ce885b39a730]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:36:51 user nova-compute[75354]: No targets found.
Nov 14 06:36:51 user nova-compute[75354]: iSNS:
Nov 14 06:36:51 user nova-compute[75354]: No targets found.
Nov 14 06:36:51 user nova-compute[75354]: STATIC:
Nov 14 06:36:51 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:36:51 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:51 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:51 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:36:51 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:36:51 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:36:51 user nova-compute[75354]: FIRMWARE:
Nov 14 06:36:51 user nova-compute[75354]: No targets found.
Nov 14 06:36:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:36:51 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:36:51 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59a001-83ee-4f35-8315-6290edddfe64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[438aaaf3-f4dd-49f0-996c-5e82fccf9397]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:51 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:36:51 user nova-compute[75354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:36:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80943e2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a915d11-fb56-46c7-a6c6-bbe458181131]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94428659-689d-4f20-91db-da48d7646b6e]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: INFO nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 14 06:36:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80003a2-7429-4a98-9008-fa1ba8582600]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af04bd0b-c1f6-4df4-aee3-fd402a86932e]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39ff72-974d-4cf4-8727-e208c2bb2ab6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:51 user nova-compute[75354]: INFO nova.compute.manager [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Took 6.64 seconds to build instance.
Nov 14 06:36:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-84a7aa56-4345-4f7c-bd93-c67819271f51 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.738s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptfwjsm7c/a9801af0019d49499c8eeb89afb10b6e.delta 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed5e1ab-27ec-4688-bd0c-44a8a9606194]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]
Nov 14 06:36:52 user nova-compute[75354]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.
Nov 14 06:36:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptfwjsm7c/a9801af0019d49499c8eeb89afb10b6e.delta 1073741824" returned: 0 in 0.053s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c7acb8-6bb6-480c-925e-006674d9a2ee]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] <== disconnect_volume: return (383ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:36:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Deleting instance files /opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6_del
Nov 14 06:36:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Deletion of /opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6_del complete
Nov 14 06:36:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updated VIF entry in instance network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": null, "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap889d4a14-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e250688f-8417-4641-9fe7-f1e673f8614f req-d59e5210-619b-4c06-85e9-764d68f42175 service nova] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:36:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:53 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Deleted allocations for instance 616cd639-1e6f-4bed-8cba-7da50d65a4d6
Nov 14 06:36:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'numa_topology' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG nova.objects.base [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Object Instance<616cd639-1e6f-4bed-8cba-7da50d65a4d6> lazy-loaded attributes: resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:36:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 06:36:53 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptfwjsm7c/a9801af0019d49499c8eeb89afb10b6e.delta /opt/stack/data/nova/instances/snapshots/tmptfwjsm7c/a9801af0019d49499c8eeb89afb10b6e {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptfwjsm7c/a9801af0019d49499c8eeb89afb10b6e.delta /opt/stack/data/nova/instances/snapshots/tmptfwjsm7c/a9801af0019d49499c8eeb89afb10b6e" returned: 0 in 0.327s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:36:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Snapshot extracted, beginning image upload
Nov 14 06:36:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f8fc0dc6-4147-486c-85d2-05dc7d49584f tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.804s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:36:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Snapshot image upload complete
Nov 14 06:36:56 user nova-compute[75354]: INFO nova.compute.manager [None req-3845445c-4ea5-496a-a3c9-1ee7bc2b5892 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Took 4.88 seconds to snapshot the instance on the hypervisor.
Nov 14 06:36:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:36:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:04 user nova-compute[75354]: INFO nova.compute.manager [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Terminating instance
Nov 14 06:37:04 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-7a30e601-3ad3-4734-9f52-e3b85b893764 req-29078f52-a29b-4a3d-b647-f615f69d4416 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-unplugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7a30e601-3ad3-4734-9f52-e3b85b893764 req-29078f52-a29b-4a3d-b647-f615f69d4416 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7a30e601-3ad3-4734-9f52-e3b85b893764 req-29078f52-a29b-4a3d-b647-f615f69d4416 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7a30e601-3ad3-4734-9f52-e3b85b893764 req-29078f52-a29b-4a3d-b647-f615f69d4416 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-7a30e601-3ad3-4734-9f52-e3b85b893764 req-29078f52-a29b-4a3d-b647-f615f69d4416 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-unplugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-7a30e601-3ad3-4734-9f52-e3b85b893764 req-29078f52-a29b-4a3d-b647-f615f69d4416 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-unplugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Instance destroyed successfully.
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lazy-loading 'resources' on Instance uuid 9ad47fd2-5e38-4ef6-a007-374bb9a21df7 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1989477807',display_name='tempest-TestVolumeSwap-server-1989477807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1989477807',id=15,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9+8pnBmxDWQM7OSxosbLVVB/Ix5O7YFVt+A2DgcJO8rJO1w/Eqv+LFEz5a4Vap5s1e08iZbNjjqNLHd/AJCtm5saAU2Z9Bg4u0xYWqtL5NP4+KR8ONB4wHuitvngnfgA==',key_name='tempest-keypair-192472840',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4c745886794abd990a6f71547f67f0',ramdisk_id='',reservation_id='r-eumf4qp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1437105103',owner_user_name='tempest-TestVolumeSwap-1437105103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07a6a0821bc7469aa98ea385fce07d6f',uuid=9ad47fd2-5e38-4ef6-a007-374bb9a21df7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Converting VIF {"id": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "address": "fa:16:3e:f2:f2:09", "network": {"id": "881ca9f9-62c8-437c-b6fc-15d050056e62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-145450156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c745886794abd990a6f71547f67f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1908e79c-26", "ovs_interfaceid": "1908e79c-265a-4dfd-91ad-ab4e87986ed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG os_vif [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1908e79c-26, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3955016-fb3e-4975-a43b-3a610feddd0a) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:05 user nova-compute[75354]: INFO os_vif [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:f2:09,bridge_name='br-int',has_traffic_filtering=True,id=1908e79c-265a-4dfd-91ad-ab4e87986ed9,network=Network(881ca9f9-62c8-437c-b6fc-15d050056e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1908e79c-26')
Nov 14 06:37:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Deleting instance files /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7_del
Nov 14 06:37:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Deletion of /opt/stack/data/nova/instances/9ad47fd2-5e38-4ef6-a007-374bb9a21df7_del complete
Nov 14 06:37:05 user nova-compute[75354]: INFO nova.compute.manager [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 06:37:05 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:37:05 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:37:06 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Took 0.88 seconds to deallocate network for instance.
Nov 14 06:37:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-36a541f0-9783-471a-bddc-d557b6802768 req-84869a33-dfad-4157-89e7-b7d8e601a9fc service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-deleted-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:37:06 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Deleted allocations for instance 9ad47fd2-5e38-4ef6-a007-374bb9a21df7
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6854c82-5f85-43b3-80a4-f23208c58da6 tempest-TestVolumeSwap-1437105103 tempest-TestVolumeSwap-1437105103-project-member] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.298s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:07 user nova-compute[75354]: WARNING nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state deleted and task_state None.
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:07 user nova-compute[75354]: WARNING nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state deleted and task_state None.
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:07 user nova-compute[75354]: WARNING nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state deleted and task_state None.
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-unplugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-unplugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:07 user nova-compute[75354]: WARNING nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-unplugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state deleted and task_state None.
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Acquiring lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] Lock "9ad47fd2-5e38-4ef6-a007-374bb9a21df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] No waiting events found dispatching network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:07 user nova-compute[75354]: WARNING nova.compute.manager [req-4e56ca3b-99ec-4e4f-98f0-25c876b6ed1e req-eb006508-fb4f-41f4-90ae-2170236f76d3 service nova] [instance: 9ad47fd2-5e38-4ef6-a007-374bb9a21df7] Received unexpected event network-vif-plugged-1908e79c-265a-4dfd-91ad-ab4e87986ed9 for instance with vm_state deleted and task_state None.
Nov 14 06:37:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:31 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:37:31 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8112MB free_disk=25.43075942993164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:37:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:35 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquired lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'info_cache' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:36 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.network.neutron [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Releasing lock "refresh_cache-68039fc4-3444-4768-aa9e-ba1cb521b5dd" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:37:37 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance destroyed successfully.
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'resources' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG os_vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedb76634-c7, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a695901-6f27-4cb1-8a2f-395f3f7dda62) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:37 user nova-compute[75354]: INFO os_vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7')
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start _get_guest_xml network_info=[{"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'numa_topology' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:37 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:37:37 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'pci_devices' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:37:37 user nova-compute[75354]:   <uuid>68039fc4-3444-4768-aa9e-ba1cb521b5dd</uuid>
Nov 14 06:37:37 user nova-compute[75354]:   <name>instance-00000002</name>
Nov 14 06:37:37 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:37:37 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:37:37 user nova-compute[75354]:   <metadata>
Nov 14 06:37:37 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:37:37 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:37:37 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeTestJSON-server-124393074</nova:name>
Nov 14 06:37:37 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:37:37</nova:creationTime>
Nov 14 06:37:37 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:37:37 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:37:37 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:37:37 user nova-compute[75354]:       <nova:owner>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:user uuid="43461d505f5f44d68823f9c9e67f1cf4">tempest-AttachVolumeTestJSON-1353209128-project-member</nova:user>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:project uuid="f809549aa1ea440abaef3e4ba37ca414">tempest-AttachVolumeTestJSON-1353209128</nova:project>
Nov 14 06:37:37 user nova-compute[75354]:       </nova:owner>
Nov 14 06:37:37 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:37:37 user nova-compute[75354]:       <nova:ports>
Nov 14 06:37:37 user nova-compute[75354]:         <nova:port uuid="edb76634-c756-41ed-ace4-5b82d24b5365">
Nov 14 06:37:37 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 06:37:37 user nova-compute[75354]:         </nova:port>
Nov 14 06:37:37 user nova-compute[75354]:       </nova:ports>
Nov 14 06:37:37 user nova-compute[75354]:     </nova:instance>
Nov 14 06:37:37 user nova-compute[75354]:   </metadata>
Nov 14 06:37:37 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:37:37 user nova-compute[75354]:     <system>
Nov 14 06:37:37 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:37:37 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:37:37 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:37:37 user nova-compute[75354]:       <entry name="serial">68039fc4-3444-4768-aa9e-ba1cb521b5dd</entry>
Nov 14 06:37:37 user nova-compute[75354]:       <entry name="uuid">68039fc4-3444-4768-aa9e-ba1cb521b5dd</entry>
Nov 14 06:37:37 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:37:37 user nova-compute[75354]:     </system>
Nov 14 06:37:37 user nova-compute[75354]:   </sysinfo>
Nov 14 06:37:37 user nova-compute[75354]:   <os>
Nov 14 06:37:37 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:37:37 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:37:37 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:37:37 user nova-compute[75354]:   </os>
Nov 14 06:37:37 user nova-compute[75354]:   <features>
Nov 14 06:37:37 user nova-compute[75354]:     <acpi/>
Nov 14 06:37:37 user nova-compute[75354]:     <apic/>
Nov 14 06:37:37 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:37:37 user nova-compute[75354]:   </features>
Nov 14 06:37:37 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:37:37 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:37:37 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:37:37 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:37:37 user nova-compute[75354]:   </clock>
Nov 14 06:37:37 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:37:37 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:37:37 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:37:37 user nova-compute[75354]:   </cpu>
Nov 14 06:37:37 user nova-compute[75354]:   <devices>
Nov 14 06:37:37 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:37:37 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:37:37 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk"/>
Nov 14 06:37:37 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:37:37 user nova-compute[75354]:     </disk>
Nov 14 06:37:37 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:37:37 user nova-compute[75354]:       <mac address="fa:16:3e:1b:86:63"/>
Nov 14 06:37:37 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:37:37 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:37:37 user nova-compute[75354]:       <target dev="tapedb76634-c7"/>
Nov 14 06:37:37 user nova-compute[75354]:     </interface>
Nov 14 06:37:37 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:37:37 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/console.log" append="off"/>
Nov 14 06:37:37 user nova-compute[75354]:     </serial>
Nov 14 06:37:37 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:37:37 user nova-compute[75354]:     <video>
Nov 14 06:37:37 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:37:37 user nova-compute[75354]:     </video>
Nov 14 06:37:37 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:37:37 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:37:37 user nova-compute[75354]:     </rng>
Nov 14 06:37:37 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:37:37 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:37:37 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:37:37 user nova-compute[75354]:     </memballoon>
Nov 14 06:37:37 user nova-compute[75354]:   </devices>
Nov 14 06:37:37 user nova-compute[75354]: </domain>
Nov 14 06:37:37 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.164s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Cannot resize image /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'migration_context' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.objects.base [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Object Instance<68039fc4-3444-4768-aa9e-ba1cb521b5dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG os_vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1d25310-fb52-5551-829a-15ef428fe434', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedb76634-c7, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedb76634-c7, col_values=(('qos', UUID('32e739d0-c7ed-4f57-9d67-bd8837a64f27')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedb76634-c7, col_values=(('external_ids', {'iface-id': 'edb76634-c756-41ed-ace4-5b82d24b5365', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:86:63', 'vm-uuid': '68039fc4-3444-4768-aa9e-ba1cb521b5dd'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:38 user nova-compute[75354]: INFO os_vif [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7')
Nov 14 06:37:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-3612acd3-c495-42d3-ac24-3e70b090ae11 req-f80cf0cf-dca3-478c-902d-3af58df4bb1b service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3612acd3-c495-42d3-ac24-3e70b090ae11 req-f80cf0cf-dca3-478c-902d-3af58df4bb1b service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3612acd3-c495-42d3-ac24-3e70b090ae11 req-f80cf0cf-dca3-478c-902d-3af58df4bb1b service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3612acd3-c495-42d3-ac24-3e70b090ae11 req-f80cf0cf-dca3-478c-902d-3af58df4bb1b service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-3612acd3-c495-42d3-ac24-3e70b090ae11 req-f80cf0cf-dca3-478c-902d-3af58df4bb1b service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:39 user nova-compute[75354]: WARNING nova.compute.manager [req-3612acd3-c495-42d3-ac24-3e70b090ae11 req-f80cf0cf-dca3-478c-902d-3af58df4bb1b service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state stopped and task_state powering-on.
Nov 14 06:37:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:37:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:37:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance rebooted successfully.
Nov 14 06:37:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-bd9cb990-3710-4caf-90e5-923403bbabd2 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:37:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-46cc7055-0fbe-4a34-82c2-303e9947c699 req-29f37652-2b49-4f80-8f8f-a13356d2689e service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:37:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-46cc7055-0fbe-4a34-82c2-303e9947c699 req-29f37652-2b49-4f80-8f8f-a13356d2689e service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:37:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-46cc7055-0fbe-4a34-82c2-303e9947c699 req-29f37652-2b49-4f80-8f8f-a13356d2689e service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:37:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-46cc7055-0fbe-4a34-82c2-303e9947c699 req-29f37652-2b49-4f80-8f8f-a13356d2689e service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:37:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-46cc7055-0fbe-4a34-82c2-303e9947c699 req-29f37652-2b49-4f80-8f8f-a13356d2689e service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:37:41 user nova-compute[75354]: WARNING nova.compute.manager [req-46cc7055-0fbe-4a34-82c2-303e9947c699 req-29f37652-2b49-4f80-8f8f-a13356d2689e service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state active and task_state None.
Nov 14 06:37:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:37:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:37:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:37:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:37:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:37:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:37:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:37:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:37:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:37:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:10 user nova-compute[75354]: INFO nova.compute.manager [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Terminating instance
Nov 14 06:38:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-c17dfb25-2f80-4dfd-b417-5bec86009105 req-cbacf06c-efb1-4bf8-a213-c64aaa071191 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c17dfb25-2f80-4dfd-b417-5bec86009105 req-cbacf06c-efb1-4bf8-a213-c64aaa071191 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c17dfb25-2f80-4dfd-b417-5bec86009105 req-cbacf06c-efb1-4bf8-a213-c64aaa071191 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c17dfb25-2f80-4dfd-b417-5bec86009105 req-cbacf06c-efb1-4bf8-a213-c64aaa071191 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-c17dfb25-2f80-4dfd-b417-5bec86009105 req-cbacf06c-efb1-4bf8-a213-c64aaa071191 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-c17dfb25-2f80-4dfd-b417-5bec86009105 req-cbacf06c-efb1-4bf8-a213-c64aaa071191 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-unplugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:38:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Instance destroyed successfully.
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lazy-loading 'resources' on Instance uuid 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-924171002',display_name='tempest-ServerActionsTestOtherB-server-924171002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-924171002',id=1,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHW26cJVMtZVd7Pyzx63pgabS64bCbFmsZgNPkrc1LH8VhYT7LOhrrbKg4Ogz1doIuxd2Lgk98a0IGtZrQiQqOrLfG3sN+sJ31/DYeH9BOmNsdTRkDVdV5EMegZ3RaaJg==',key_name='tempest-keypair-1813344961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:35:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a152b44325b84778b31a79b9faf1b443',ramdisk_id='',reservation_id='r-7gy1vufo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-766403064',owner_user_name='tempest-ServerActionsTestOtherB-766403064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7678e8df1dc94bb999962858edc7ec5f',uuid=787b732d-c4cc-4cf1-8069-6a8d0458b3b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converting VIF {"id": "307913af-8833-4c78-8600-a43bbc913f5a", "address": "fa:16:3e:f8:4e:57", "network": {"id": "12d205b3-3a88-420e-941d-68546df158bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-660529357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a152b44325b84778b31a79b9faf1b443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307913af-88", "ovs_interfaceid": "307913af-8833-4c78-8600-a43bbc913f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_vif [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307913af-88, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0feaed0f-8889-4660-bc98-baf1db2aea19) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:11 user nova-compute[75354]: INFO os_vif [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4e:57,bridge_name='br-int',has_traffic_filtering=True,id=307913af-8833-4c78-8600-a43bbc913f5a,network=Network(12d205b3-3a88-420e-941d-68546df158bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307913af-88')
Nov 14 06:38:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrIjaFCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ade6b5-213a-4a8d-941c-4b256c9fc909]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:38:11 user nova-compute[75354]: No targets found.
Nov 14 06:38:11 user nova-compute[75354]: iSNS:
Nov 14 06:38:11 user nova-compute[75354]: No targets found.
Nov 14 06:38:11 user nova-compute[75354]: STATIC:
Nov 14 06:38:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf
Nov 14 06:38:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:38:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:38:11 user nova-compute[75354]: FIRMWARE:
Nov 14 06:38:11 user nova-compute[75354]: No targets found.
Nov 14 06:38:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:38:11 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:38:11 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb6af07-d5ba-46dc-9759-a0d53157e177]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506ee85-d0d2-404d-8968-24cbb3b4154c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:38:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf (non-flash)
Nov 14 06:38:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074464e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a5e0a0-e63d-40a0-a9da-a7898a514ff7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae8eca8-cb74-4bd3-b58b-7e9ab2cf44d5]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fe2b3b-0cdd-4ba6-9d93-0826550a1c3d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e6a94-2aad-49bc-aeb2-c128fe756dca]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a8c76f-80c4-48b7-8c32-08a7520436e2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[058df9e2-c1fa-4a31-88be-a907139150a3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260]
Nov 14 06:38:12 user nova-compute[75354]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf, portal: 172.16.0.220,3260] successful.
Nov 14 06:38:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c91fe45-218d-4ce4-85c9-fbf4ab5b5fbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3cdddd-cc08-4947-ad3b-2bb2b6e8c742]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] <== disconnect_volume: return (309ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:38:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Deleting instance files /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9_del
Nov 14 06:38:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Deletion of /opt/stack/data/nova/instances/787b732d-c4cc-4cf1-8069-6a8d0458b3b9_del complete
Nov 14 06:38:12 user nova-compute[75354]: INFO nova.compute.manager [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 06:38:12 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:38:12 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:13 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Took 0.99 seconds to deallocate network for instance.
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-b9a5450c-f65f-4a02-93cd-89c8fe3ef839 req-432ec393-ce19-49fe-beaf-dc1b8904e724 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-deleted-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:13 user nova-compute[75354]: INFO nova.compute.manager [req-b9a5450c-f65f-4a02-93cd-89c8fe3ef839 req-432ec393-ce19-49fe-beaf-dc1b8904e724 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Neutron deleted interface 307913af-8833-4c78-8600-a43bbc913f5a; detaching it from the instance and deleting it from the info cache
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-b9a5450c-f65f-4a02-93cd-89c8fe3ef839 req-432ec393-ce19-49fe-beaf-dc1b8904e724 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-b9a5450c-f65f-4a02-93cd-89c8fe3ef839 req-432ec393-ce19-49fe-beaf-dc1b8904e724 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Detach interface failed, port_id=307913af-8833-4c78-8600-a43bbc913f5a, reason: Instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:38:13 user nova-compute[75354]: INFO nova.compute.claims [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Claim successful on node user
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-6d6c5d6e-b7c6-431d-bc50-6e97213d5b59 req-1ad636f3-eec5-4138-963c-011531668491 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6d6c5d6e-b7c6-431d-bc50-6e97213d5b59 req-1ad636f3-eec5-4138-963c-011531668491 service nova] Acquiring lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6d6c5d6e-b7c6-431d-bc50-6e97213d5b59 req-1ad636f3-eec5-4138-963c-011531668491 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6d6c5d6e-b7c6-431d-bc50-6e97213d5b59 req-1ad636f3-eec5-4138-963c-011531668491 service nova] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-6d6c5d6e-b7c6-431d-bc50-6e97213d5b59 req-1ad636f3-eec5-4138-963c-011531668491 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] No waiting events found dispatching network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:13 user nova-compute[75354]: WARNING nova.compute.manager [req-6d6c5d6e-b7c6-431d-bc50-6e97213d5b59 req-1ad636f3-eec5-4138-963c-011531668491 service nova] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Received unexpected event network-vif-plugged-307913af-8833-4c78-8600-a43bbc913f5a for instance with vm_state active and task_state deleting.
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:38:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:38:13 user nova-compute[75354]: INFO nova.virt.block_device [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Booting with blank volume at /dev/vda
Nov 14 06:38:13 user nova-compute[75354]: DEBUG nova.policy [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfc31b05a2848128a837f170ac63b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0fdd525e8a49aeac22892962d8b14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:38:13 user nova-compute[75354]: INFO nova.compute.manager [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] [instance: 787b732d-c4cc-4cf1-8069-6a8d0458b3b9] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:14 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:38:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:38:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:14 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Deleted allocations for instance 787b732d-c4cc-4cf1-8069-6a8d0458b3b9
Nov 14 06:38:14 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Successfully created port: 155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:38:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d3c93658-40c8-4e50-b06b-de784c7f1734 tempest-ServerActionsTestOtherB-766403064 tempest-ServerActionsTestOtherB-766403064-project-member] Lock "787b732d-c4cc-4cf1-8069-6a8d0458b3b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.457s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Successfully updated port: 155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-changed-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Refreshing instance network info cache due to event network-changed-155db473-e304-43ef-8f72-a416833af65a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] Acquiring lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance network_info: |[{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] Acquired lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Refreshing network info cache for port 155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updated VIF entry in instance network info cache for port 155db473-e304-43ef-8f72-a416833af65a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a4873096-efb3-4c59-9b0c-66d098dcc49a req-517402ca-197a-4124-b94a-30417ca39fdb service nova] Releasing lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:18 user nova-compute[75354]: INFO nova.compute.manager [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Unshelving
Nov 14 06:38:18 user nova-compute[75354]: INFO nova.virt.block_device [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Booting with volume 19b1e382-2814-452f-b14d-91fb9da79aee at /dev/vdc
Nov 14 06:38:18 user nova-compute[75354]: DEBUG os_brick.utils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94505c9-ce4b-4dae-afb1-9e3d3836a91a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c566768-e4c5-4328-99fe-0643d4a55ef0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[563762c8-b4f7-4636-a4a8-bf4a15fd9f44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c25381-56eb-448e-94b5-5cbfd9805e6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:18 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:38:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca532b0e-278c-4ebc-863a-8668fde62435]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:38:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.utils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating existing volume attachment record: 4b31b33d-e85c-4758-890c-a8fc077e1a93 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.utils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80721ad-45ac-4e19-916d-9d2d9c0145ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b370a-c6ed-42c7-b7e5-e42855d1f97a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf6f7cf-ea2e-4ccb-b890-e79f069be060]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b2b34-1591-4ee3-904e-f49a70ae555a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:19 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:38:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb0074-53f2-4791-bac3-866e0e22ae3d]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG os_brick.utils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:19 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating existing volume attachment record: af4833dd-3b25-4579-a97d-3be33e8edc40 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:38:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:23 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'pci_requests' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:23 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'numa_topology' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:38:23 user nova-compute[75354]: INFO nova.compute.claims [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Claim successful on node user
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:24 user nova-compute[75354]: INFO nova.network.neutron [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:38:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Creating image(s)
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Start _get_guest_xml network_info=[{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9fa44e1b-6893-43f1-a435-3ef2fc914a1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'serial': 'c7ebef2e-f32d-4d78-bef2-473e138ca7a0'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'af4833dd-3b25-4579-a97d-3be33e8edc40', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:38:24 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:24 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:24 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:24 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:24 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing instance network info cache due to event network-changed-4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28462b3e-be8b-4b64-b571-53ed9752b0a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:38:24 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a12c65-01c5-4350-a684-20b0a2046f5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0] added
Nov 14 06:38:24 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[999dab33-c66f-4761-920b-ddff5f856621]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32699df4-a18f-4abe-95ea-4b53a04657ce]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDBTSbx {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDBTSbx" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[86261e2b-420f-4b5b-8c3a-07006b0f80c9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpDBTSbx'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af745e2f-2be3-4fe4-af74-cd51bff4e6c2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d01e538-deb8-40c8-b6a9-775357e9f3fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 06:38:25 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 06:38:25 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:25 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 06:38:25 user nova-compute[75354]: 
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cde3d5-6cf0-44ed-9570-79102da64a52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260]
Nov 14 06:38:25 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260] successful.
Nov 14 06:38:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bb3a70-d3ac-4aa2-b66a-882f9ee335ab]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ceee57-5cde-43b4-8ea9-936d195b214b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81188ea6-0647-4dec-bb13-227d64459a5f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:38:25 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Creating image(s)
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG nova.network.neutron [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Refreshing network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG nova.objects.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<73aaf228-084d-4d35-acd9-27db3536287f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "7a9ad953c96180d45006a79d80e2f29e783df2d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "7a9ad953c96180d45006a79d80e2f29e783df2d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.691s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== connect_volume: return (1694ms) {'type': 'block', 'scsi_wwn': '26662313435346234', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662313435346234', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:38:26 user nova-compute[75354]: INFO nova.compute.manager [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Rescuing
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.network.neutron [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740472689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740472689',id=21,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-v7lgv8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:14Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=9fa44e1b-6893-43f1-a435-3ef2fc914a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:38:26 user nova-compute[75354]:   <uuid>9fa44e1b-6893-43f1-a435-3ef2fc914a1d</uuid>
Nov 14 06:38:26 user nova-compute[75354]:   <name>instance-00000015</name>
Nov 14 06:38:26 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:38:26 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:38:26 user nova-compute[75354]:   <metadata>
Nov 14 06:38:26 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:38:26 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:38:26 user nova-compute[75354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1740472689</nova:name>
Nov 14 06:38:26 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:38:24</nova:creationTime>
Nov 14 06:38:26 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:38:26 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:38:26 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:38:26 user nova-compute[75354]:       <nova:owner>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:user uuid="2dfc31b05a2848128a837f170ac63b93">tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member</nova:user>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:project uuid="7e0fdd525e8a49aeac22892962d8b14e">tempest-ServerBootFromVolumeStableRescueTest-1883221150</nova:project>
Nov 14 06:38:26 user nova-compute[75354]:       </nova:owner>
Nov 14 06:38:26 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:38:26 user nova-compute[75354]:       <nova:ports>
Nov 14 06:38:26 user nova-compute[75354]:         <nova:port uuid="155db473-e304-43ef-8f72-a416833af65a">
Nov 14 06:38:26 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:38:26 user nova-compute[75354]:         </nova:port>
Nov 14 06:38:26 user nova-compute[75354]:       </nova:ports>
Nov 14 06:38:26 user nova-compute[75354]:     </nova:instance>
Nov 14 06:38:26 user nova-compute[75354]:   </metadata>
Nov 14 06:38:26 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:38:26 user nova-compute[75354]:     <system>
Nov 14 06:38:26 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:38:26 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:38:26 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:38:26 user nova-compute[75354]:       <entry name="serial">9fa44e1b-6893-43f1-a435-3ef2fc914a1d</entry>
Nov 14 06:38:26 user nova-compute[75354]:       <entry name="uuid">9fa44e1b-6893-43f1-a435-3ef2fc914a1d</entry>
Nov 14 06:38:26 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:38:26 user nova-compute[75354]:     </system>
Nov 14 06:38:26 user nova-compute[75354]:   </sysinfo>
Nov 14 06:38:26 user nova-compute[75354]:   <os>
Nov 14 06:38:26 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:38:26 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:38:26 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:38:26 user nova-compute[75354]:   </os>
Nov 14 06:38:26 user nova-compute[75354]:   <features>
Nov 14 06:38:26 user nova-compute[75354]:     <acpi/>
Nov 14 06:38:26 user nova-compute[75354]:     <apic/>
Nov 14 06:38:26 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:38:26 user nova-compute[75354]:   </features>
Nov 14 06:38:26 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:38:26 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:38:26 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:38:26 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:38:26 user nova-compute[75354]:   </clock>
Nov 14 06:38:26 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:38:26 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:38:26 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:38:26 user nova-compute[75354]:   </cpu>
Nov 14 06:38:26 user nova-compute[75354]:   <devices>
Nov 14 06:38:26 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:38:26 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:38:26 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 06:38:26 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:38:26 user nova-compute[75354]:       <serial>c7ebef2e-f32d-4d78-bef2-473e138ca7a0</serial>
Nov 14 06:38:26 user nova-compute[75354]:     </disk>
Nov 14 06:38:26 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:38:26 user nova-compute[75354]:       <mac address="fa:16:3e:5e:02:f4"/>
Nov 14 06:38:26 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:26 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:38:26 user nova-compute[75354]:       <target dev="tap155db473-e3"/>
Nov 14 06:38:26 user nova-compute[75354]:     </interface>
Nov 14 06:38:26 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:38:26 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/console.log" append="off"/>
Nov 14 06:38:26 user nova-compute[75354]:     </serial>
Nov 14 06:38:26 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:38:26 user nova-compute[75354]:     <video>
Nov 14 06:38:26 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:26 user nova-compute[75354]:     </video>
Nov 14 06:38:26 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:38:26 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:38:26 user nova-compute[75354]:     </rng>
Nov 14 06:38:26 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:38:26 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:38:26 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:38:26 user nova-compute[75354]:     </memballoon>
Nov 14 06:38:26 user nova-compute[75354]:   </devices>
Nov 14 06:38:26 user nova-compute[75354]: </domain>
Nov 14 06:38:26 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740472689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740472689',id=21,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-v7lgv8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:14Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=9fa44e1b-6893-43f1-a435-3ef2fc914a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG os_vif [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a33a4b1a-9c15-54db-8242-542bf2c475a2', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap155db473-e3, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap155db473-e3, col_values=(('qos', UUID('4b1713fd-fef2-4cf7-8e5b-e2fc807701bf')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap155db473-e3, col_values=(('external_ids', {'iface-id': '155db473-e304-43ef-8f72-a416833af65a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:02:f4', 'vm-uuid': '9fa44e1b-6893-43f1-a435-3ef2fc914a1d'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:26 user nova-compute[75354]: INFO os_vif [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3')
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.images [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] ce68234c-b1a2-445a-ba7b-c592b59cce2f was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.part /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No VIF found with MAC fa:16:3e:5e:02:f4, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.part /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.converted" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "7a9ad953c96180d45006a79d80e2f29e783df2d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.737s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.network.neutron [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updated VIF entry in instance network info cache for port 4861783a-e44a-4b1b-9edb-016d3d2cf8ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.network.neutron [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ee6ee92d-b696-4793-b617-afc460ee23e8 req-69529c5b-d416-44c4-9cb2-6e14c047c847 service nova] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.network.neutron [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "7a9ad953c96180d45006a79d80e2f29e783df2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "7a9ad953c96180d45006a79d80e2f29e783df2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9,backing_fmt=raw /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9,backing_fmt=raw /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk 1073741824" returned: 0 in 0.094s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "7a9ad953c96180d45006a79d80e2f29e783df2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-5d8d5819-5159-41f5-8ee3-fce9635ebf71 req-742d9fc7-3f96-4567-b4ee-158be2e4fbec service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5d8d5819-5159-41f5-8ee3-fce9635ebf71 req-742d9fc7-3f96-4567-b4ee-158be2e4fbec service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5d8d5819-5159-41f5-8ee3-fce9635ebf71 req-742d9fc7-3f96-4567-b4ee-158be2e4fbec service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5d8d5819-5159-41f5-8ee3-fce9635ebf71 req-742d9fc7-3f96-4567-b4ee-158be2e4fbec service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-5d8d5819-5159-41f5-8ee3-fce9635ebf71 req-742d9fc7-3f96-4567-b4ee-158be2e4fbec service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:27 user nova-compute[75354]: WARNING nova.compute.manager [req-5d8d5819-5159-41f5-8ee3-fce9635ebf71 req-742d9fc7-3f96-4567-b4ee-158be2e4fbec service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state active and task_state rescuing.
Nov 14 06:38:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'migration_context' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG nova.objects.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<73aaf228-084d-4d35-acd9-27db3536287f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:27 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Rebasing disk image.
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 -F raw /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-0ee3bfc9-946f-4141-b5ac-cee435711064 req-7379fe83-6533-4c64-9f15-24d99e0b95a5 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0ee3bfc9-946f-4141-b5ac-cee435711064 req-7379fe83-6533-4c64-9f15-24d99e0b95a5 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0ee3bfc9-946f-4141-b5ac-cee435711064 req-7379fe83-6533-4c64-9f15-24d99e0b95a5 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0ee3bfc9-946f-4141-b5ac-cee435711064 req-7379fe83-6533-4c64-9f15-24d99e0b95a5 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-0ee3bfc9-946f-4141-b5ac-cee435711064 req-7379fe83-6533-4c64-9f15-24d99e0b95a5 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:28 user nova-compute[75354]: WARNING nova.compute.manager [req-0ee3bfc9-946f-4141-b5ac-cee435711064 req-7379fe83-6533-4c64-9f15-24d99e0b95a5 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state building and task_state spawning.
Nov 14 06:38:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance destroyed successfully.
Nov 14 06:38:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Attempting rescue
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:38:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Creating image(s)
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.objects.instance [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue" returned: 0 in 0.046s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.objects.instance [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'migration_context' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:38:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.base [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<4f8c2f10-c9dc-4094-832a-bd5ea80160a3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Start _get_guest_xml network_info=[{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:da:e9:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '013c3665-3f76-488b-92b6-f08787e9badf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'resources' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.base [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<4f8c2f10-c9dc-4094-832a-bd5ea80160a3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.base [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<4f8c2f10-c9dc-4094-832a-bd5ea80160a3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.base [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<4f8c2f10-c9dc-4094-832a-bd5ea80160a3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1459502704',display_name='tempest-ServerRescueNegativeTestJSON-server-1459502704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1459502704',id=13,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:33:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-0i4xxzk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:33:52Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=4f8c2f10-c9dc-4094-832a-bd5ea80160a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:da:e9:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:da:e9:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.objects.base [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<4f8c2f10-c9dc-4094-832a-bd5ea80160a3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:38:29 user nova-compute[75354]:   <uuid>4f8c2f10-c9dc-4094-832a-bd5ea80160a3</uuid>
Nov 14 06:38:29 user nova-compute[75354]:   <name>instance-0000000d</name>
Nov 14 06:38:29 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:38:29 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:38:29 user nova-compute[75354]:   <metadata>
Nov 14 06:38:29 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:38:29 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:38:29 user nova-compute[75354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1459502704</nova:name>
Nov 14 06:38:29 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:38:29</nova:creationTime>
Nov 14 06:38:29 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:38:29 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:38:29 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:38:29 user nova-compute[75354]:       <nova:owner>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:user uuid="7f141a1ef1b44b34b09a8f2f88d5af17">tempest-ServerRescueNegativeTestJSON-2059994566-project-member</nova:user>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:project uuid="601a7175bd194f79b4ae31d34f724de4">tempest-ServerRescueNegativeTestJSON-2059994566</nova:project>
Nov 14 06:38:29 user nova-compute[75354]:       </nova:owner>
Nov 14 06:38:29 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:38:29 user nova-compute[75354]:       <nova:ports>
Nov 14 06:38:29 user nova-compute[75354]:         <nova:port uuid="25cb9c60-0a6b-44e6-8ac3-56b1daa1608b">
Nov 14 06:38:29 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 06:38:29 user nova-compute[75354]:         </nova:port>
Nov 14 06:38:29 user nova-compute[75354]:       </nova:ports>
Nov 14 06:38:29 user nova-compute[75354]:     </nova:instance>
Nov 14 06:38:29 user nova-compute[75354]:   </metadata>
Nov 14 06:38:29 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:38:29 user nova-compute[75354]:     <system>
Nov 14 06:38:29 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:38:29 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:38:29 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:38:29 user nova-compute[75354]:       <entry name="serial">4f8c2f10-c9dc-4094-832a-bd5ea80160a3</entry>
Nov 14 06:38:29 user nova-compute[75354]:       <entry name="uuid">4f8c2f10-c9dc-4094-832a-bd5ea80160a3</entry>
Nov 14 06:38:29 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:38:29 user nova-compute[75354]:     </system>
Nov 14 06:38:29 user nova-compute[75354]:   </sysinfo>
Nov 14 06:38:29 user nova-compute[75354]:   <os>
Nov 14 06:38:29 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:38:29 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:38:29 user nova-compute[75354]:   </os>
Nov 14 06:38:29 user nova-compute[75354]:   <features>
Nov 14 06:38:29 user nova-compute[75354]:     <acpi/>
Nov 14 06:38:29 user nova-compute[75354]:     <apic/>
Nov 14 06:38:29 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:38:29 user nova-compute[75354]:   </features>
Nov 14 06:38:29 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:38:29 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:38:29 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:38:29 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:38:29 user nova-compute[75354]:   </clock>
Nov 14 06:38:29 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:38:29 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:38:29 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:38:29 user nova-compute[75354]:   </cpu>
Nov 14 06:38:29 user nova-compute[75354]:   <devices>
Nov 14 06:38:29 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:38:29 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:38:29 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue"/>
Nov 14 06:38:29 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:38:29 user nova-compute[75354]:     </disk>
Nov 14 06:38:29 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:38:29 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:38:29 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk"/>
Nov 14 06:38:29 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:38:29 user nova-compute[75354]:     </disk>
Nov 14 06:38:29 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:38:29 user nova-compute[75354]:       <mac address="fa:16:3e:da:e9:1b"/>
Nov 14 06:38:29 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:29 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:38:29 user nova-compute[75354]:       <target dev="tap25cb9c60-0a"/>
Nov 14 06:38:29 user nova-compute[75354]:     </interface>
Nov 14 06:38:29 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:38:29 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/console.log" append="off"/>
Nov 14 06:38:29 user nova-compute[75354]:     </serial>
Nov 14 06:38:29 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:38:29 user nova-compute[75354]:     <video>
Nov 14 06:38:29 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:29 user nova-compute[75354]:     </video>
Nov 14 06:38:29 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:38:29 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:38:29 user nova-compute[75354]:     </rng>
Nov 14 06:38:29 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:38:29 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:38:29 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:38:29 user nova-compute[75354]:     </memballoon>
Nov 14 06:38:29 user nova-compute[75354]:   </devices>
Nov 14 06:38:29 user nova-compute[75354]: </domain>
Nov 14 06:38:29 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:38:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance destroyed successfully.
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:da:e9:1b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d9c0cda-bafc-4258-86c4-bc112ac86e9a req-fd9ec56c-c9fc-4849-8cba-f4c7421b2ed1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d9c0cda-bafc-4258-86c4-bc112ac86e9a req-fd9ec56c-c9fc-4849-8cba-f4c7421b2ed1 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d9c0cda-bafc-4258-86c4-bc112ac86e9a req-fd9ec56c-c9fc-4849-8cba-f4c7421b2ed1 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d9c0cda-bafc-4258-86c4-bc112ac86e9a req-fd9ec56c-c9fc-4849-8cba-f4c7421b2ed1 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d9c0cda-bafc-4258-86c4-bc112ac86e9a req-fd9ec56c-c9fc-4849-8cba-f4c7421b2ed1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:29 user nova-compute[75354]: WARNING nova.compute.manager [req-2d9c0cda-bafc-4258-86c4-bc112ac86e9a req-fd9ec56c-c9fc-4849-8cba-f4c7421b2ed1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state active and task_state rescuing.
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 -F raw /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk" returned: 0 in 2.441s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-440bba1a-ee35-49e8-a7d8-4c5f7101a633 req-e9a3f511-44d4-436d-bfc3-14cff25901fd service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-440bba1a-ee35-49e8-a7d8-4c5f7101a633 req-e9a3f511-44d4-436d-bfc3-14cff25901fd service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-440bba1a-ee35-49e8-a7d8-4c5f7101a633 req-e9a3f511-44d4-436d-bfc3-14cff25901fd service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-440bba1a-ee35-49e8-a7d8-4c5f7101a633 req-e9a3f511-44d4-436d-bfc3-14cff25901fd service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-440bba1a-ee35-49e8-a7d8-4c5f7101a633 req-e9a3f511-44d4-436d-bfc3-14cff25901fd service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:30 user nova-compute[75354]: WARNING nova.compute.manager [req-440bba1a-ee35-49e8-a7d8-4c5f7101a633 req-e9a3f511-44d4-436d-bfc3-14cff25901fd service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state building and task_state spawning.
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Ensure instance console log exists: /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Start _get_guest_xml network_info=[{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3b810043184852e494ba88e46af3d7f5',container_format='bare',created_at=2023-11-14T06:36:27Z,direct_url=<?>,disk_format='qcow2',id=ce68234c-b1a2-445a-ba7b-c592b59cce2f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1340763703-shelved',owner='00f5ecd6fc1944b583d57d14e2a0559e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T06:36:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UafMzuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '73aaf228-084d-4d35-acd9-27db3536287f', 'attached_at': '', 'detached_at': '', 'volume_id': '19b1e382-2814-452f-b14d-91fb9da79aee', 'serial': '19b1e382-2814-452f-b14d-91fb9da79aee'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': '4b31b33d-e85c-4758-890c-a8fc077e1a93', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.487s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:30 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3b810043184852e494ba88e46af3d7f5',container_format='bare',created_at=2023-11-14T06:36:27Z,direct_url=<?>,disk_format='qcow2',id=ce68234c-b1a2-445a-ba7b-c592b59cce2f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1340763703-shelved',owner='00f5ecd6fc1944b583d57d14e2a0559e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T06:36:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.objects.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<73aaf228-084d-4d35-acd9-27db3536287f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UafMzuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:30 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:30 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:30 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bcd33d-f120-4b78-82be-cca04387954d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:38:30 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad99ac-ca6b-4fde-8d5e-2560881ccd81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee] added
Nov 14 06:38:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0191ff-8a22-4ed9-a513-d2cc830cdb48]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b77b2-552b-4552-a1d5-0a295780d995]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UafMzuvQ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UafMzuvQ" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424896c-163a-4bfb-a9b3-51b69ddf571d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UafMzuvQ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86880a-a0cf-48c7-bf01-7520eee58842]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f70ba-a15d-4729-b23e-51ccde4e947d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f5d09-9e18-4f31-802b-dcb76843df11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260]
Nov 14 06:38:30 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260] successful.
Nov 14 06:38:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581a2d0-2162-419f-9b54-f8c3d20a04e9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa85902-7504-4bb1-ad60-2c0f15e75981]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:30 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:30 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:30 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0049359a-5fec-4995-a961-56b676052a6f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:38:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UafMzuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:38:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance spawned successfully.
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:31 user nova-compute[75354]: INFO nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: INFO nova.compute.manager [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Took 18.05 seconds to build instance.
Nov 14 06:38:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c689cd77-30ce-40b3-bcbe-fbe04dbabdd3 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.187s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23231633633656234', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231633633656234', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1340763703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1340763703',id=17,image_ref='ce68234c-b1a2-445a-ba7b-c592b59cce2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1770135778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-yfqwzrrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member',shelved_at='2023-11-14T06:36:30.657076',shelved_host='user',shelved_image_id='ce68234c-b1a2-445a-ba7b-c592b59cce2f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=73aaf228-084d-4d35-acd9-27db3536287f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'pci_devices' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.objects.base [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<73aaf228-084d-4d35-acd9-27db3536287f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:38:31 user nova-compute[75354]:   <uuid>73aaf228-084d-4d35-acd9-27db3536287f</uuid>
Nov 14 06:38:31 user nova-compute[75354]:   <name>instance-00000011</name>
Nov 14 06:38:31 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:38:31 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:38:31 user nova-compute[75354]:   <metadata>
Nov 14 06:38:31 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:38:31 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:38:31 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1340763703</nova:name>
Nov 14 06:38:31 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:38:30</nova:creationTime>
Nov 14 06:38:31 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:38:31 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:38:31 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:38:31 user nova-compute[75354]:       <nova:owner>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:user uuid="70d7d1261dfa452cacd628da418f7783">tempest-AttachVolumeShelveTestJSON-443282580-project-member</nova:user>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:project uuid="00f5ecd6fc1944b583d57d14e2a0559e">tempest-AttachVolumeShelveTestJSON-443282580</nova:project>
Nov 14 06:38:31 user nova-compute[75354]:       </nova:owner>
Nov 14 06:38:31 user nova-compute[75354]:       <nova:root type="image" uuid="ce68234c-b1a2-445a-ba7b-c592b59cce2f"/>
Nov 14 06:38:31 user nova-compute[75354]:       <nova:ports>
Nov 14 06:38:31 user nova-compute[75354]:         <nova:port uuid="4861783a-e44a-4b1b-9edb-016d3d2cf8ef">
Nov 14 06:38:31 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 06:38:31 user nova-compute[75354]:         </nova:port>
Nov 14 06:38:31 user nova-compute[75354]:       </nova:ports>
Nov 14 06:38:31 user nova-compute[75354]:     </nova:instance>
Nov 14 06:38:31 user nova-compute[75354]:   </metadata>
Nov 14 06:38:31 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:38:31 user nova-compute[75354]:     <system>
Nov 14 06:38:31 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:38:31 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:38:31 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:38:31 user nova-compute[75354]:       <entry name="serial">73aaf228-084d-4d35-acd9-27db3536287f</entry>
Nov 14 06:38:31 user nova-compute[75354]:       <entry name="uuid">73aaf228-084d-4d35-acd9-27db3536287f</entry>
Nov 14 06:38:31 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:38:31 user nova-compute[75354]:     </system>
Nov 14 06:38:31 user nova-compute[75354]:   </sysinfo>
Nov 14 06:38:31 user nova-compute[75354]:   <os>
Nov 14 06:38:31 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:38:31 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:38:31 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:38:31 user nova-compute[75354]:   </os>
Nov 14 06:38:31 user nova-compute[75354]:   <features>
Nov 14 06:38:31 user nova-compute[75354]:     <acpi/>
Nov 14 06:38:31 user nova-compute[75354]:     <apic/>
Nov 14 06:38:31 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:38:31 user nova-compute[75354]:   </features>
Nov 14 06:38:31 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:38:31 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:38:31 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:38:31 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:38:31 user nova-compute[75354]:   </clock>
Nov 14 06:38:31 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:38:31 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:38:31 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:38:31 user nova-compute[75354]:   </cpu>
Nov 14 06:38:31 user nova-compute[75354]:   <devices>
Nov 14 06:38:31 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:38:31 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:38:31 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk"/>
Nov 14 06:38:31 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:38:31 user nova-compute[75354]:     </disk>
Nov 14 06:38:31 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:38:31 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:38:31 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 06:38:31 user nova-compute[75354]:       <target dev="vdc" bus="virtio"/>
Nov 14 06:38:31 user nova-compute[75354]:       <serial>19b1e382-2814-452f-b14d-91fb9da79aee</serial>
Nov 14 06:38:31 user nova-compute[75354]:     </disk>
Nov 14 06:38:31 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:38:31 user nova-compute[75354]:       <mac address="fa:16:3e:1c:f3:d6"/>
Nov 14 06:38:31 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:31 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:38:31 user nova-compute[75354]:       <target dev="tap4861783a-e4"/>
Nov 14 06:38:31 user nova-compute[75354]:     </interface>
Nov 14 06:38:31 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:38:31 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/console.log" append="off"/>
Nov 14 06:38:31 user nova-compute[75354]:     </serial>
Nov 14 06:38:31 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:38:31 user nova-compute[75354]:     <video>
Nov 14 06:38:31 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:31 user nova-compute[75354]:     </video>
Nov 14 06:38:31 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:38:31 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:38:31 user nova-compute[75354]:     </rng>
Nov 14 06:38:31 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:38:31 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:38:31 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:38:31 user nova-compute[75354]:     </memballoon>
Nov 14 06:38:31 user nova-compute[75354]:   </devices>
Nov 14 06:38:31 user nova-compute[75354]: </domain>
Nov 14 06:38:31 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1340763703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1340763703',id=17,image_ref='ce68234c-b1a2-445a-ba7b-c592b59cce2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1770135778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-yfqwzrrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member',shelved_at='2023-11-14T06:36:30.657076',shelved_host='user',shelved_image_id='ce68234c-b1a2-445a-ba7b-c592b59cce2f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=73aaf228-084d-4d35-acd9-27db3536287f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG os_vif [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19881b81-e345-53af-b862-1f676e0ecd75', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4861783a-e4, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4861783a-e4, col_values=(('qos', UUID('a729aff6-ae6a-4aa1-b78a-d45395e1940b')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4861783a-e4, col_values=(('external_ids', {'iface-id': '4861783a-e44a-4b1b-9edb-016d3d2cf8ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:f3:d6', 'vm-uuid': '73aaf228-084d-4d35-acd9-27db3536287f'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:31 user nova-compute[75354]: INFO os_vif [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4')
Nov 14 06:38:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No VIF found with MAC fa:16:3e:1c:f3:d6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-519596dd-1da5-437f-bafc-cb51a9bbe7e6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-22ae9eb5-34be-496f-83b7-10c7415898c5 req-08b50264-595e-4faf-ab08-6e6158b295c6 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-22ae9eb5-34be-496f-83b7-10c7415898c5 req-08b50264-595e-4faf-ab08-6e6158b295c6 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-22ae9eb5-34be-496f-83b7-10c7415898c5 req-08b50264-595e-4faf-ab08-6e6158b295c6 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-22ae9eb5-34be-496f-83b7-10c7415898c5 req-08b50264-595e-4faf-ab08-6e6158b295c6 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-22ae9eb5-34be-496f-83b7-10c7415898c5 req-08b50264-595e-4faf-ab08-6e6158b295c6 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:33 user nova-compute[75354]: WARNING nova.compute.manager [req-22ae9eb5-34be-496f-83b7-10c7415898c5 req-08b50264-595e-4faf-ab08-6e6158b295c6 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 06:38:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-60c47cba-5626-472b-99b8-21050ba3cb1c req-15e9edd4-30df-4aa0-b7ac-46c6ae94dc18 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-60c47cba-5626-472b-99b8-21050ba3cb1c req-15e9edd4-30df-4aa0-b7ac-46c6ae94dc18 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-60c47cba-5626-472b-99b8-21050ba3cb1c req-15e9edd4-30df-4aa0-b7ac-46c6ae94dc18 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-60c47cba-5626-472b-99b8-21050ba3cb1c req-15e9edd4-30df-4aa0-b7ac-46c6ae94dc18 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-60c47cba-5626-472b-99b8-21050ba3cb1c req-15e9edd4-30df-4aa0-b7ac-46c6ae94dc18 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:36 user nova-compute[75354]: WARNING nova.compute.manager [req-60c47cba-5626-472b-99b8-21050ba3cb1c req-15e9edd4-30df-4aa0-b7ac-46c6ae94dc18 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state rescued and task_state None.
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-ac5096ad-e4b8-4853-9ffd-ad45a9d5cfc3 req-2e67f261-e328-46c6-b77b-e366f17a7b42 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ac5096ad-e4b8-4853-9ffd-ad45a9d5cfc3 req-2e67f261-e328-46c6-b77b-e366f17a7b42 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ac5096ad-e4b8-4853-9ffd-ad45a9d5cfc3 req-2e67f261-e328-46c6-b77b-e366f17a7b42 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ac5096ad-e4b8-4853-9ffd-ad45a9d5cfc3 req-2e67f261-e328-46c6-b77b-e366f17a7b42 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-ac5096ad-e4b8-4853-9ffd-ad45a9d5cfc3 req-2e67f261-e328-46c6-b77b-e366f17a7b42 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:36 user nova-compute[75354]: WARNING nova.compute.manager [req-ac5096ad-e4b8-4853-9ffd-ad45a9d5cfc3 req-2e67f261-e328-46c6-b77b-e366f17a7b42 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 06:38:36 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance spawned successfully.
Nov 14 06:38:36 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:36 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=25.357215881347656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (639f2b20-6e4a-4044-8740-35d2f7c0a858): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-f496fab3-a0f0-4c1f-86d4-d95d412b3cca req-ff71511d-1701-4e7d-8e82-e9ca7f8508ca service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f496fab3-a0f0-4c1f-86d4-d95d412b3cca req-ff71511d-1701-4e7d-8e82-e9ca7f8508ca service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f496fab3-a0f0-4c1f-86d4-d95d412b3cca req-ff71511d-1701-4e7d-8e82-e9ca7f8508ca service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f496fab3-a0f0-4c1f-86d4-d95d412b3cca req-ff71511d-1701-4e7d-8e82-e9ca7f8508ca service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-f496fab3-a0f0-4c1f-86d4-d95d412b3cca req-ff71511d-1701-4e7d-8e82-e9ca7f8508ca service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:36 user nova-compute[75354]: WARNING nova.compute.manager [req-f496fab3-a0f0-4c1f-86d4-d95d412b3cca req-ff71511d-1701-4e7d-8e82-e9ca7f8508ca service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state rescued and task_state None.
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7bbc9434-d502-419a-904e-aa9af1825778 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.983s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-changed-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Refreshing instance network info cache due to event network-changed-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:38:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] Acquiring lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] Acquired lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Refreshing network info cache for port a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:38:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updated VIF entry in instance network info cache for port a3cd5c83-b585-4d06-9990-c2d4e9d1b96c. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:38:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ebc7bf7-018c-4013-8c8c-41269420ca2c req-d5750ccf-0e8d-453a-8c6a-c830adf9894c service nova] Releasing lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:41 user nova-compute[75354]: INFO nova.compute.manager [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Unshelving
Nov 14 06:38:41 user nova-compute[75354]: INFO nova.virt.block_device [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Booting with volume 2e86fa27-bf93-42c5-8dd9-45e429842a02 at /dev/vda
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG os_brick.utils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6868523-c431-4174-a0aa-42906b7a5f46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce23070b-708e-491c-917e-640c4da602f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ebb8a-9915-4070-a6cf-a71804393a06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0294c57-996e-4681-812d-6d2c4c28fa4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:41 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d873fad-1ad1-4027-926d-ff31eec8a896]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG os_brick.utils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating existing volume attachment record: c58547fe-56da-4894-831d-a260b3f1ad4b {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:38:41 user nova-compute[75354]: INFO nova.compute.claims [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Claim successful on node user
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:38:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'flavor' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:38:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Creating image(s)
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "/opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "/opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "/opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:42 user nova-compute[75354]: INFO nova.compute.manager [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Attaching volume b94f5e26-b428-4ec6-8c3d-9fd4337960d4 to /dev/vdb
Nov 14 06:38:42 user nova-compute[75354]: DEBUG os_brick.utils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2414fc-8485-4ccb-b3ea-6b749ece8ccb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca4b8bd-997a-45aa-80bb-22abc4912ea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.policy [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1959e146b024fad873f92cf252aec6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081861be85ab4c6eae414a2f8b98fde4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd907b-0e1d-4e63-8de1-aba42a2f21f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54191062-6962-4de5-8b05-9df3b08c4fbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:38:42 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:38:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2380a114-1a65-4271-802e-9001969a54b9]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG os_brick.utils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:42 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating existing volume attachment record: 37dd71b7-f9ab-434f-b296-7be686f7b397 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk 1073741824" returned: 0 in 0.060s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.201s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Cannot resize image /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Ensure instance console log exists: /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Successfully created port: 5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Successfully updated port: 5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquired lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-changed-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Refreshing instance network info cache due to event network-changed-5d061eec-f1c9-4dc0-942e-952053f85720. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] Acquiring lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updating instance_info_cache with network_info: [{"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Releasing lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Instance network_info: |[{"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] Acquired lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Refreshing network info cache for port 5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Start _get_guest_xml network_info=[{"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:38:44 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:44 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1427091481',display_name='tempest-VolumesSnapshotTestJSON-instance-1427091481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1427091481',id=22,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6g/GraOImzeziG6lfw9Cg0gcpjAk535UfHdPHt2z22pbYFvr4rn3dgJuyMQ5qSdZ7TKaO/vM+djpgFo9E6qbhxIDG1h124BI4sJFBx1/aEhR3+FAxZovprA8Ey+voPOw==',key_name='tempest-keypair-1121458293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='081861be85ab4c6eae414a2f8b98fde4',ramdisk_id='',reservation_id='r-ral6f0ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-518810154',owner_user_name='tempest-VolumesSnapshotTestJSON-518810154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1959e146b024fad873f92cf252aec6b',uuid=43e8f13f-dbae-4b75-a14d-f563ba912701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converting VIF {"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'pci_devices' on Instance uuid 43e8f13f-dbae-4b75-a14d-f563ba912701 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:38:44 user nova-compute[75354]:   <uuid>43e8f13f-dbae-4b75-a14d-f563ba912701</uuid>
Nov 14 06:38:44 user nova-compute[75354]:   <name>instance-00000016</name>
Nov 14 06:38:44 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:38:44 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:38:44 user nova-compute[75354]:   <metadata>
Nov 14 06:38:44 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:38:44 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:38:44 user nova-compute[75354]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1427091481</nova:name>
Nov 14 06:38:44 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:38:44</nova:creationTime>
Nov 14 06:38:44 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:38:44 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:38:44 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:38:44 user nova-compute[75354]:       <nova:owner>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:user uuid="d1959e146b024fad873f92cf252aec6b">tempest-VolumesSnapshotTestJSON-518810154-project-member</nova:user>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:project uuid="081861be85ab4c6eae414a2f8b98fde4">tempest-VolumesSnapshotTestJSON-518810154</nova:project>
Nov 14 06:38:44 user nova-compute[75354]:       </nova:owner>
Nov 14 06:38:44 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:38:44 user nova-compute[75354]:       <nova:ports>
Nov 14 06:38:44 user nova-compute[75354]:         <nova:port uuid="5d061eec-f1c9-4dc0-942e-952053f85720">
Nov 14 06:38:44 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 06:38:44 user nova-compute[75354]:         </nova:port>
Nov 14 06:38:44 user nova-compute[75354]:       </nova:ports>
Nov 14 06:38:44 user nova-compute[75354]:     </nova:instance>
Nov 14 06:38:44 user nova-compute[75354]:   </metadata>
Nov 14 06:38:44 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:38:44 user nova-compute[75354]:     <system>
Nov 14 06:38:44 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:38:44 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:38:44 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:38:44 user nova-compute[75354]:       <entry name="serial">43e8f13f-dbae-4b75-a14d-f563ba912701</entry>
Nov 14 06:38:44 user nova-compute[75354]:       <entry name="uuid">43e8f13f-dbae-4b75-a14d-f563ba912701</entry>
Nov 14 06:38:44 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:38:44 user nova-compute[75354]:     </system>
Nov 14 06:38:44 user nova-compute[75354]:   </sysinfo>
Nov 14 06:38:44 user nova-compute[75354]:   <os>
Nov 14 06:38:44 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:38:44 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:38:44 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:38:44 user nova-compute[75354]:   </os>
Nov 14 06:38:44 user nova-compute[75354]:   <features>
Nov 14 06:38:44 user nova-compute[75354]:     <acpi/>
Nov 14 06:38:44 user nova-compute[75354]:     <apic/>
Nov 14 06:38:44 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:38:44 user nova-compute[75354]:   </features>
Nov 14 06:38:44 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:38:44 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:38:44 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:38:44 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:38:44 user nova-compute[75354]:   </clock>
Nov 14 06:38:44 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:38:44 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:38:44 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:38:44 user nova-compute[75354]:   </cpu>
Nov 14 06:38:44 user nova-compute[75354]:   <devices>
Nov 14 06:38:44 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:38:44 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:38:44 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk"/>
Nov 14 06:38:44 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:38:44 user nova-compute[75354]:     </disk>
Nov 14 06:38:44 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:38:44 user nova-compute[75354]:       <mac address="fa:16:3e:9f:71:99"/>
Nov 14 06:38:44 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:44 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:38:44 user nova-compute[75354]:       <target dev="tap5d061eec-f1"/>
Nov 14 06:38:44 user nova-compute[75354]:     </interface>
Nov 14 06:38:44 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:38:44 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/console.log" append="off"/>
Nov 14 06:38:44 user nova-compute[75354]:     </serial>
Nov 14 06:38:44 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:38:44 user nova-compute[75354]:     <video>
Nov 14 06:38:44 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:44 user nova-compute[75354]:     </video>
Nov 14 06:38:44 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:38:44 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:38:44 user nova-compute[75354]:     </rng>
Nov 14 06:38:44 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:38:44 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:38:44 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:38:44 user nova-compute[75354]:     </memballoon>
Nov 14 06:38:44 user nova-compute[75354]:   </devices>
Nov 14 06:38:44 user nova-compute[75354]: </domain>
Nov 14 06:38:44 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1427091481',display_name='tempest-VolumesSnapshotTestJSON-instance-1427091481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1427091481',id=22,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6g/GraOImzeziG6lfw9Cg0gcpjAk535UfHdPHt2z22pbYFvr4rn3dgJuyMQ5qSdZ7TKaO/vM+djpgFo9E6qbhxIDG1h124BI4sJFBx1/aEhR3+FAxZovprA8Ey+voPOw==',key_name='tempest-keypair-1121458293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='081861be85ab4c6eae414a2f8b98fde4',ramdisk_id='',reservation_id='r-ral6f0ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-518810154',owner_user_name='tempest-VolumesSnapshotTestJSON-518810154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1959e146b024fad873f92cf252aec6b',uuid=43e8f13f-dbae-4b75-a14d-f563ba912701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converting VIF {"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG os_vif [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7789b262-c8b5-520a-81b5-a10c58f7cfd1', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d061eec-f1, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d061eec-f1, col_values=(('qos', UUID('86147786-6155-4ec8-ab1e-27bfb859fb6f')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d061eec-f1, col_values=(('external_ids', {'iface-id': '5d061eec-f1c9-4dc0-942e-952053f85720', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:71:99', 'vm-uuid': '43e8f13f-dbae-4b75-a14d-f563ba912701'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:44 user nova-compute[75354]: INFO os_vif [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1')
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No VIF found with MAC fa:16:3e:9f:71:99, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updated VIF entry in instance network info cache for port 5d061eec-f1c9-4dc0-942e-952053f85720. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updating instance_info_cache with network_info: [{"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8c89c09b-63fa-4cd8-bdcc-3a5b35b83ea3 req-00802d66-a23f-4fb8-8e31-1400d5376687 service nova] Releasing lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'pci_requests' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'numa_topology' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:38:46 user nova-compute[75354]: INFO nova.compute.claims [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Claim successful on node user
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-35a5a4a9-55ef-4838-a741-ba8860a6907e req-69b7f8fb-0570-48a5-9355-3d063042c5f0 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-35a5a4a9-55ef-4838-a741-ba8860a6907e req-69b7f8fb-0570-48a5-9355-3d063042c5f0 service nova] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-35a5a4a9-55ef-4838-a741-ba8860a6907e req-69b7f8fb-0570-48a5-9355-3d063042c5f0 service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-35a5a4a9-55ef-4838-a741-ba8860a6907e req-69b7f8fb-0570-48a5-9355-3d063042c5f0 service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-35a5a4a9-55ef-4838-a741-ba8860a6907e req-69b7f8fb-0570-48a5-9355-3d063042c5f0 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] No waiting events found dispatching network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:46 user nova-compute[75354]: WARNING nova.compute.manager [req-35a5a4a9-55ef-4838-a741-ba8860a6907e req-69b7f8fb-0570-48a5-9355-3d063042c5f0 service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received unexpected event network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 for instance with vm_state building and task_state spawning.
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:38:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:46 user nova-compute[75354]: INFO nova.network.neutron [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating port 889d4a14-a052-4bea-91b7-639f6fd83e58 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohBUNzmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:47 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:47 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:47 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[427bfc84-62b4-485c-9b87-48133260dfdf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:38:47 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cbfafc-707c-47c1-801b-7d579dc27fe3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4] added
Nov 14 06:38:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa61347-42b4-4be2-a358-ee9148e29b1d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f381fd-5911-49df-92d6-6bf1c818e780]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ohBUNzmT {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:38:47 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Creating image(s)
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Ensure instance console log exists: /opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Start _get_guest_xml network_info=[{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '616cd639-1e6f-4bed-8cba-7da50d65a4d6', 'attached_at': '', 'detached_at': '', 'volume_id': '2e86fa27-bf93-42c5-8dd9-45e429842a02', 'serial': '2e86fa27-bf93-42c5-8dd9-45e429842a02'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'c58547fe-56da-4894-831d-a260b3f1ad4b', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ohBUNzmT" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b4c494-f594-45d2-bf6f-669e0663a260]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ohBUNzmT'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'vcpu_model' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc3d82-9fc3-431e-859a-40cb51d45f4a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.objects.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Object Instance<616cd639-1e6f-4bed-8cba-7da50d65a4d6> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:47 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b27787-04c0-4fd8-bc59-d28e170f8bbb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:47 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:47 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8119e330-2301-4e4a-aa99-3545507eced6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260]
Nov 14 06:38:47 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260] successful.
Nov 14 06:38:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6970f8-a229-41c1-aa8c-51168601931f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[69963c0b-7848-45e8-806e-39c69e0073a7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:48 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:48 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:48 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:48 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae3c0e-b91c-4c4d-bcf4-0b1cb50d129f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohBUNzmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:38:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Instance spawned successfully.
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] No waiting events found dispatching network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:48 user nova-compute[75354]: WARNING nova.compute.manager [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received unexpected event network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 for instance with vm_state building and task_state spawning.
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing instance network info cache due to event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:38:48 user nova-compute[75354]: INFO nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:38:48 user nova-compute[75354]: INFO nova.compute.manager [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Took 6.59 seconds to build instance.
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd96bedf-501a-4b0b-887e-0c9c8f5a979e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updated VIF entry in instance network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b08c2855-f3f6-4391-97ba-fd7153306fbe req-a8d772e5-4762-4f27-b342-91251f6d090e service nova] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23932323862343730', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932323862343730', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.155s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:49 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:49 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'flavor' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ca6ba5-4088-4bfc-8e8f-7a33ad5c2fcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:38:49 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:38:49 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:38:49 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:38:49 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:38:49 user nova-compute[75354]:   <serial>b94f5e26-b428-4ec6-8c3d-9fd4337960d4</serial>
Nov 14 06:38:49 user nova-compute[75354]: </disk>
Nov 14 06:38:49 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e70f10-1c8e-4c4e-a30b-f961ced41210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02] added
Nov 14 06:38:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fb4470-47b4-4422-b75f-48a4df9d9826]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05c871c-ebff-4635-a0dc-1d448f417a7a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaXNJxcr {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaXNJxcr" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f158da-6209-47ae-b2a5-821f94c8da2f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oaXNJxcr'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2079c7a-4b72-4456-89f1-d282232c6ca0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbaaaff-9857-446c-8415-635f93188469]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aea7a9-db7a-4d3f-802c-fe5d03604105]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]
Nov 14 06:38:49 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.
Nov 14 06:38:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bf94f9-301b-4d48-8c60-819872b24104]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b5aa3-b4a2-4dce-9cd9-2e013694fafb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:38:49 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bfc579-6c99-403e-b431-b95fa1ae9dcb]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No VIF found with MAC fa:16:3e:ac:7f:c4, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a66f6ab9-d172-44d5-ac5b-90beb6dbe815 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.985s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] <== connect_volume: return (2514ms) {'type': 'block', 'scsi_wwn': '23536653830366439', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536653830366439', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2003753906',display_name='tempest-TestShelveInstance-server-2003753906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2003753906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-578191332',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:35:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ba1cd9f605474fe8a451637996110491',ramdisk_id='',reservation_id='r-0eh2op4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1170608310',owner_user_name='tempest-TestShelveInstance-1170608310-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:38:41Z,user_data=None,user_id='61fe146c06734be7a7039cb754015019',uuid=616cd639-1e6f-4bed-8cba-7da50d65a4d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converting VIF {"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'pci_devices' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.objects.base [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Object Instance<616cd639-1e6f-4bed-8cba-7da50d65a4d6> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:38:50 user nova-compute[75354]:   <uuid>616cd639-1e6f-4bed-8cba-7da50d65a4d6</uuid>
Nov 14 06:38:50 user nova-compute[75354]:   <name>instance-00000012</name>
Nov 14 06:38:50 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:38:50 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:38:50 user nova-compute[75354]:   <metadata>
Nov 14 06:38:50 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:38:50 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:38:50 user nova-compute[75354]:       <nova:name>tempest-TestShelveInstance-server-2003753906</nova:name>
Nov 14 06:38:50 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:38:47</nova:creationTime>
Nov 14 06:38:50 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:38:50 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:38:50 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:38:50 user nova-compute[75354]:       <nova:owner>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:user uuid="61fe146c06734be7a7039cb754015019">tempest-TestShelveInstance-1170608310-project-member</nova:user>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:project uuid="ba1cd9f605474fe8a451637996110491">tempest-TestShelveInstance-1170608310</nova:project>
Nov 14 06:38:50 user nova-compute[75354]:       </nova:owner>
Nov 14 06:38:50 user nova-compute[75354]:       <nova:ports>
Nov 14 06:38:50 user nova-compute[75354]:         <nova:port uuid="889d4a14-a052-4bea-91b7-639f6fd83e58">
Nov 14 06:38:50 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:38:50 user nova-compute[75354]:         </nova:port>
Nov 14 06:38:50 user nova-compute[75354]:       </nova:ports>
Nov 14 06:38:50 user nova-compute[75354]:     </nova:instance>
Nov 14 06:38:50 user nova-compute[75354]:   </metadata>
Nov 14 06:38:50 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:38:50 user nova-compute[75354]:     <system>
Nov 14 06:38:50 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:38:50 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:38:50 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:38:50 user nova-compute[75354]:       <entry name="serial">616cd639-1e6f-4bed-8cba-7da50d65a4d6</entry>
Nov 14 06:38:50 user nova-compute[75354]:       <entry name="uuid">616cd639-1e6f-4bed-8cba-7da50d65a4d6</entry>
Nov 14 06:38:50 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:38:50 user nova-compute[75354]:     </system>
Nov 14 06:38:50 user nova-compute[75354]:   </sysinfo>
Nov 14 06:38:50 user nova-compute[75354]:   <os>
Nov 14 06:38:50 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:38:50 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:38:50 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:38:50 user nova-compute[75354]:   </os>
Nov 14 06:38:50 user nova-compute[75354]:   <features>
Nov 14 06:38:50 user nova-compute[75354]:     <acpi/>
Nov 14 06:38:50 user nova-compute[75354]:     <apic/>
Nov 14 06:38:50 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:38:50 user nova-compute[75354]:   </features>
Nov 14 06:38:50 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:38:50 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:38:50 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:38:50 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:38:50 user nova-compute[75354]:   </clock>
Nov 14 06:38:50 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:38:50 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:38:50 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:38:50 user nova-compute[75354]:   </cpu>
Nov 14 06:38:50 user nova-compute[75354]:   <devices>
Nov 14 06:38:50 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:38:50 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:38:50 user nova-compute[75354]:       <source dev="/dev/sde"/>
Nov 14 06:38:50 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:38:50 user nova-compute[75354]:       <serial>2e86fa27-bf93-42c5-8dd9-45e429842a02</serial>
Nov 14 06:38:50 user nova-compute[75354]:     </disk>
Nov 14 06:38:50 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:38:50 user nova-compute[75354]:       <mac address="fa:16:3e:8d:80:e5"/>
Nov 14 06:38:50 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:50 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:38:50 user nova-compute[75354]:       <target dev="tap889d4a14-a0"/>
Nov 14 06:38:50 user nova-compute[75354]:     </interface>
Nov 14 06:38:50 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:38:50 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6/console.log" append="off"/>
Nov 14 06:38:50 user nova-compute[75354]:     </serial>
Nov 14 06:38:50 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:38:50 user nova-compute[75354]:     <video>
Nov 14 06:38:50 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:50 user nova-compute[75354]:     </video>
Nov 14 06:38:50 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:38:50 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:38:50 user nova-compute[75354]:     </rng>
Nov 14 06:38:50 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:38:50 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:38:50 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:38:50 user nova-compute[75354]:     </memballoon>
Nov 14 06:38:50 user nova-compute[75354]:   </devices>
Nov 14 06:38:50 user nova-compute[75354]: </domain>
Nov 14 06:38:50 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2003753906',display_name='tempest-TestShelveInstance-server-2003753906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2003753906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-578191332',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:35:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ba1cd9f605474fe8a451637996110491',ramdisk_id='',reservation_id='r-0eh2op4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1170608310',owner_user_name='tempest-TestShelveInstance-1170608310-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:38:41Z,user_data=None,user_id='61fe146c06734be7a7039cb754015019',uuid=616cd639-1e6f-4bed-8cba-7da50d65a4d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converting VIF {"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG os_vif [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8326e75-4288-54e6-9faa-194e1aff1a77', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap889d4a14-a0, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap889d4a14-a0, col_values=(('qos', UUID('a43f3405-d847-4266-b8df-c0c4dc3dda28')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap889d4a14-a0, col_values=(('external_ids', {'iface-id': '889d4a14-a052-4bea-91b7-639f6fd83e58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:80:e5', 'vm-uuid': '616cd639-1e6f-4bed-8cba-7da50d65a4d6'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:50 user nova-compute[75354]: INFO os_vif [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0')
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] No VIF found with MAC fa:16:3e:8d:80:e5, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:50 user nova-compute[75354]: INFO nova.compute.manager [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Rescuing
Nov 14 06:38:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:38:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG nova.network.neutron [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-e3bcf78f-c3c8-4388-96df-58e03a3e947f req-6162cd54-8212-44ee-a386-59b7eddf1481 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e3bcf78f-c3c8-4388-96df-58e03a3e947f req-6162cd54-8212-44ee-a386-59b7eddf1481 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e3bcf78f-c3c8-4388-96df-58e03a3e947f req-6162cd54-8212-44ee-a386-59b7eddf1481 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e3bcf78f-c3c8-4388-96df-58e03a3e947f req-6162cd54-8212-44ee-a386-59b7eddf1481 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-e3bcf78f-c3c8-4388-96df-58e03a3e947f req-6162cd54-8212-44ee-a386-59b7eddf1481 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:51 user nova-compute[75354]: WARNING nova.compute.manager [req-e3bcf78f-c3c8-4388-96df-58e03a3e947f req-6162cd54-8212-44ee-a386-59b7eddf1481 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state active and task_state rescuing.
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-588166e0-e93b-4795-b3f2-3629d717db19 req-12f699ec-05fa-49f3-879f-e97d31b1fea4 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-588166e0-e93b-4795-b3f2-3629d717db19 req-12f699ec-05fa-49f3-879f-e97d31b1fea4 service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-588166e0-e93b-4795-b3f2-3629d717db19 req-12f699ec-05fa-49f3-879f-e97d31b1fea4 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-588166e0-e93b-4795-b3f2-3629d717db19 req-12f699ec-05fa-49f3-879f-e97d31b1fea4 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-588166e0-e93b-4795-b3f2-3629d717db19 req-12f699ec-05fa-49f3-879f-e97d31b1fea4 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:52 user nova-compute[75354]: WARNING nova.compute.manager [req-588166e0-e93b-4795-b3f2-3629d717db19 req-12f699ec-05fa-49f3-879f-e97d31b1fea4 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 06:38:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance destroyed successfully.
Nov 14 06:38:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Attempting a stable device rescue
Nov 14 06:38:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:38:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Creating image(s)
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "bdf884958b488997f4a07b58c6958d103f76e63e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "bdf884958b488997f4a07b58c6958d103f76e63e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-227f9ce9-0f1e-492a-b5c6-513dc67015f1 req-f53ab5dc-a768-4c9e-9d53-46b2e940ef8a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-227f9ce9-0f1e-492a-b5c6-513dc67015f1 req-f53ab5dc-a768-4c9e-9d53-46b2e940ef8a service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-227f9ce9-0f1e-492a-b5c6-513dc67015f1 req-f53ab5dc-a768-4c9e-9d53-46b2e940ef8a service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-227f9ce9-0f1e-492a-b5c6-513dc67015f1 req-f53ab5dc-a768-4c9e-9d53-46b2e940ef8a service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-227f9ce9-0f1e-492a-b5c6-513dc67015f1 req-f53ab5dc-a768-4c9e-9d53-46b2e940ef8a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:53 user nova-compute[75354]: WARNING nova.compute.manager [req-227f9ce9-0f1e-492a-b5c6-513dc67015f1 req-f53ab5dc-a768-4c9e-9d53-46b2e940ef8a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state active and task_state rescuing.
Nov 14 06:38:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG nova.virt.images [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] 9c19d083-e0f5-42f0-8631-9e1f46256420 was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:38:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.part /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-c7b5bce9-12e9-488e-9e0b-0fe9e0462e7b req-5b12c5a6-82f9-4946-a3c2-17d007e15b26 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c7b5bce9-12e9-488e-9e0b-0fe9e0462e7b req-5b12c5a6-82f9-4946-a3c2-17d007e15b26 service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c7b5bce9-12e9-488e-9e0b-0fe9e0462e7b req-5b12c5a6-82f9-4946-a3c2-17d007e15b26 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c7b5bce9-12e9-488e-9e0b-0fe9e0462e7b req-5b12c5a6-82f9-4946-a3c2-17d007e15b26 service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-c7b5bce9-12e9-488e-9e0b-0fe9e0462e7b req-5b12c5a6-82f9-4946-a3c2-17d007e15b26 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:54 user nova-compute[75354]: WARNING nova.compute.manager [req-c7b5bce9-12e9-488e-9e0b-0fe9e0462e7b req-5b12c5a6-82f9-4946-a3c2-17d007e15b26 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.part /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.converted" returned: 0 in 0.505s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "bdf884958b488997f4a07b58c6958d103f76e63e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.855s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "bdf884958b488997f4a07b58c6958d103f76e63e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "bdf884958b488997f4a07b58c6958d103f76e63e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:38:54 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance spawned successfully.
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6087655f-dd36-40b0-9f88-8ab1ceef8784 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.614s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e,backing_fmt=raw /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e,backing_fmt=raw /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue" returned: 0 in 0.062s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "bdf884958b488997f4a07b58c6958d103f76e63e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'migration_context' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Object Instance<5c304a52-fe97-4cf5-88fc-cda18858cf50> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Start _get_guest_xml network_info=[{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "vif_mac": "fa:16:3e:ac:7f:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9c19d083-e0f5-42f0-8631-9e1f46256420', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohBUNzmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5c304a52-fe97-4cf5-88fc-cda18858cf50', 'attached_at': '', 'detached_at': '', 'volume_id': 'b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'serial': 'b94f5e26-b428-4ec6-8c3d-9fd4337960d4'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '37dd71b7-f9ab-434f-b296-7be686f7b397', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'resources' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Object Instance<5c304a52-fe97-4cf5-88fc-cda18858cf50> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'numa_topology' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Object Instance<5c304a52-fe97-4cf5-88fc-cda18858cf50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:54 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:54 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.objects.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Object Instance<5c304a52-fe97-4cf5-88fc-cda18858cf50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohBUNzmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:38:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:38:54 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccf52a3-d819-4cf6-a4e8-50545996b790]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ohBUNzmT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 06:38:54 user nova-compute[75354]: node.name = iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:38:54 user nova-compute[75354]: node.tpgt = -1
Nov 14 06:38:54 user nova-compute[75354]: node.startup = automatic
Nov 14 06:38:54 user nova-compute[75354]: node.leading_login = No
Nov 14 06:38:54 user nova-compute[75354]: iface.iscsi_ifacename = default
Nov 14 06:38:54 user nova-compute[75354]: iface.net_ifacename = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.ipaddress = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.prefix_len = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.hwaddress = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.transport_name = tcp
Nov 14 06:38:54 user nova-compute[75354]: iface.initiatorname = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.vlan_id = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.vlan_priority = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.vlan_state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.iface_num = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.mtu = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.port = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.bootproto = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.subnet_mask = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.gateway = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_alt_client_id = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_dns = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_learn_iqn = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_vendor_id_state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_vendor_id = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.dhcp_slp_da = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.fragmentation = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.gratuitous_arp = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.incoming_forwarding = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.tos_state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.tos = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.ttl = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.delayed_ack = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.tcp_nagle = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.tcp_wsf_state = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.tcp_wsf = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.tcp_timer_scale = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.tcp_timestamp = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.redirect = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.def_task_mgmt_timeout = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.header_digest = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.data_digest = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.immediate_data = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.initial_r2t = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.data_seq_inorder = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.data_pdu_inorder = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.erl = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.max_receive_data_len = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.first_burst_len = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.max_outstanding_r2t = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.max_burst_len = 0
Nov 14 06:38:54 user nova-compute[75354]: iface.chap_auth = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.bidi_chap = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.strict_login_compliance = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.discovery_auth = <empty>
Nov 14 06:38:54 user nova-compute[75354]: iface.discovery_logout = <empty>
Nov 14 06:38:54 user nova-compute[75354]: node.discovery_address = <empty>
Nov 14 06:38:54 user nova-compute[75354]: node.discovery_port = 0
Nov 14 06:38:54 user nova-compute[75354]: node.discovery_type = static
Nov 14 06:38:54 user nova-compute[75354]: node.session.initial_cmdsn = 0
Nov 14 06:38:54 user nova-compute[75354]: node.session.initial_login_retry_max = 8
Nov 14 06:38:54 user nova-compute[75354]: node.session.xmit_thread_priority = -20
Nov 14 06:38:54 user nova-compute[75354]: node.session.cmds_max = 128
Nov 14 06:38:54 user nova-compute[75354]: node.session.queue_depth = 32
Nov 14 06:38:54 user nova-compute[75354]: node.session.nr_sessions = 1
Nov 14 06:38:54 user nova-compute[75354]: node.session.auth.authmethod = CHAP
Nov 14 06:38:54 user nova-compute[75354]: node.session.auth.username = ohBUNzmT
Nov 14 06:38:54 user nova-compute[75354]: node.session.auth.password = ***
Nov 14 06:38:54 user nova-compute[75354]: node.session.auth.username_in = <empty>
Nov 14 06:38:54 user nova-compute[75354]: node.session.auth.password_in = <empty>
Nov 14 06:38:54 user nova-compute[75354]: node.session.auth.chap_algs = MD5
Nov 14 06:38:54 user nova-compute[75354]: node.session.timeo.replacement_timeout = 120
Nov 14 06:38:54 user nova-compute[75354]: node.session.err_timeo.abort_timeout = 15
Nov 14 06:38:54 user nova-compute[75354]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 06:38:54 user nova-compute[75354]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 06:38:54 user nova-compute[75354]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.FastAbort = Yes
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.InitialR2T = No
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.ImmediateData = Yes
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.MaxConnections = 1
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 06:38:54 user nova-compute[75354]: node.session.iscsi.ERL = 0
Nov 14 06:38:54 user nova-compute[75354]: node.session.scan = manual
Nov 14 06:38:54 user nova-compute[75354]: node.session.reopen_max = 0
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].address = 172.16.0.220
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].port = 3260
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].startup = manual
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].tcp.window_size = 524288
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].tcp.type_of_service = 0
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].timeo.logout_timeout = 15
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].timeo.login_timeout = 15
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].timeo.auth_timeout = 45
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].iscsi.DataDigest = None
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].iscsi.IFMarker = No
Nov 14 06:38:54 user nova-compute[75354]: node.conn[0].iscsi.OFMarker = No
Nov 14 06:38:54 user nova-compute[75354]: # END RECORD
Nov 14 06:38:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f5320b-2f1b-459c-a6bf-8d0a2239f346]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc81640c-289a-4568-8a74-1071213cae90]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ohBUNzmT {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ohBUNzmT" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a531e9-a8bc-4c4f-81f3-bcaa40b746cc]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ohBUNzmT'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9804c6c5-fb8d-472b-a5a0-7e68cdc624d1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:38:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c73b2e-3ccf-4224-9aee-42dc1d1763db]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:55 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:55 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:55 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:38:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:38:55 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:38:55 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:38:55 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:38:55 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b59f71-6d14-4a0d-8de3-70b623187154]: (4, ('0 0 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohBUNzmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23932323862343730', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932323862343730', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-345416593',display_name='tempest-ServerStableDeviceRescueTest-server-345416593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-345416593',id=19,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZR5pP6FsBgkL8Zrc4FgO5hbq2x8EryNGCtSLww6ZvFPZMwxvSVBkedxHUJHZOdxGyzz6rqx3IaItfVR0WBep5naWgrGI0ci+APiVyPKKNlIoNQczcjWiyoCHKtsvFmmA==',key_name='tempest-keypair-505318022',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c10d2458fb34f8fb75bf2d227b047b8',ramdisk_id='',reservation_id='r-je2ls6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1966013656',owner_user_name='tempest-ServerStableDeviceRescueTest-1966013656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db86d1a052c40678cb7e4efe76a6dd9',uuid=5c304a52-fe97-4cf5-88fc-cda18858cf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "vif_mac": "fa:16:3e:ac:7f:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converting VIF {"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "vif_mac": "fa:16:3e:ac:7f:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.objects.base [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Object Instance<5c304a52-fe97-4cf5-88fc-cda18858cf50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:38:55 user nova-compute[75354]:   <uuid>5c304a52-fe97-4cf5-88fc-cda18858cf50</uuid>
Nov 14 06:38:55 user nova-compute[75354]:   <name>instance-00000013</name>
Nov 14 06:38:55 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:38:55 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:38:55 user nova-compute[75354]:   <metadata>
Nov 14 06:38:55 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:38:55 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:38:55 user nova-compute[75354]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-345416593</nova:name>
Nov 14 06:38:55 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:38:54</nova:creationTime>
Nov 14 06:38:55 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:38:55 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:38:55 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:38:55 user nova-compute[75354]:       <nova:owner>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:user uuid="1db86d1a052c40678cb7e4efe76a6dd9">tempest-ServerStableDeviceRescueTest-1966013656-project-member</nova:user>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:project uuid="4c10d2458fb34f8fb75bf2d227b047b8">tempest-ServerStableDeviceRescueTest-1966013656</nova:project>
Nov 14 06:38:55 user nova-compute[75354]:       </nova:owner>
Nov 14 06:38:55 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:38:55 user nova-compute[75354]:       <nova:ports>
Nov 14 06:38:55 user nova-compute[75354]:         <nova:port uuid="b8ea2ee8-43e9-42bc-96d1-aa78c39beca1">
Nov 14 06:38:55 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 06:38:55 user nova-compute[75354]:         </nova:port>
Nov 14 06:38:55 user nova-compute[75354]:       </nova:ports>
Nov 14 06:38:55 user nova-compute[75354]:     </nova:instance>
Nov 14 06:38:55 user nova-compute[75354]:   </metadata>
Nov 14 06:38:55 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:38:55 user nova-compute[75354]:     <system>
Nov 14 06:38:55 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:38:55 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:38:55 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:38:55 user nova-compute[75354]:       <entry name="serial">5c304a52-fe97-4cf5-88fc-cda18858cf50</entry>
Nov 14 06:38:55 user nova-compute[75354]:       <entry name="uuid">5c304a52-fe97-4cf5-88fc-cda18858cf50</entry>
Nov 14 06:38:55 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:38:55 user nova-compute[75354]:     </system>
Nov 14 06:38:55 user nova-compute[75354]:   </sysinfo>
Nov 14 06:38:55 user nova-compute[75354]:   <os>
Nov 14 06:38:55 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:38:55 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:38:55 user nova-compute[75354]:   </os>
Nov 14 06:38:55 user nova-compute[75354]:   <features>
Nov 14 06:38:55 user nova-compute[75354]:     <acpi/>
Nov 14 06:38:55 user nova-compute[75354]:     <apic/>
Nov 14 06:38:55 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:38:55 user nova-compute[75354]:   </features>
Nov 14 06:38:55 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:38:55 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:38:55 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:38:55 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:38:55 user nova-compute[75354]:   </clock>
Nov 14 06:38:55 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:38:55 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:38:55 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:38:55 user nova-compute[75354]:   </cpu>
Nov 14 06:38:55 user nova-compute[75354]:   <devices>
Nov 14 06:38:55 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:38:55 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:38:55 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk"/>
Nov 14 06:38:55 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:38:55 user nova-compute[75354]:     </disk>
Nov 14 06:38:55 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:38:55 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:38:55 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 06:38:55 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:38:55 user nova-compute[75354]:       <serial>b94f5e26-b428-4ec6-8c3d-9fd4337960d4</serial>
Nov 14 06:38:55 user nova-compute[75354]:     </disk>
Nov 14 06:38:55 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:38:55 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:38:55 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue"/>
Nov 14 06:38:55 user nova-compute[75354]:       <target dev="vdc" bus="virtio"/>
Nov 14 06:38:55 user nova-compute[75354]:       <boot order="1"/>
Nov 14 06:38:55 user nova-compute[75354]:     </disk>
Nov 14 06:38:55 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:38:55 user nova-compute[75354]:       <mac address="fa:16:3e:ac:7f:c4"/>
Nov 14 06:38:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:55 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:38:55 user nova-compute[75354]:       <target dev="tapb8ea2ee8-43"/>
Nov 14 06:38:55 user nova-compute[75354]:     </interface>
Nov 14 06:38:55 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:38:55 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/console.log" append="off"/>
Nov 14 06:38:55 user nova-compute[75354]:     </serial>
Nov 14 06:38:55 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:38:55 user nova-compute[75354]:     <video>
Nov 14 06:38:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:38:55 user nova-compute[75354]:     </video>
Nov 14 06:38:55 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:38:55 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:38:55 user nova-compute[75354]:     </rng>
Nov 14 06:38:55 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:38:55 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:38:55 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:38:55 user nova-compute[75354]:     </memballoon>
Nov 14 06:38:55 user nova-compute[75354]:   </devices>
Nov 14 06:38:55 user nova-compute[75354]: </domain>
Nov 14 06:38:55 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:38:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance destroyed successfully.
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] No VIF found with MAC fa:16:3e:ac:7f:c4, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:38:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-02f7c0e4-675b-4d01-90ae-411a64c292c0 req-f5d616b1-61e5-4022-9a94-7bc3c88edd3e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-02f7c0e4-675b-4d01-90ae-411a64c292c0 req-f5d616b1-61e5-4022-9a94-7bc3c88edd3e service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-02f7c0e4-675b-4d01-90ae-411a64c292c0 req-f5d616b1-61e5-4022-9a94-7bc3c88edd3e service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-02f7c0e4-675b-4d01-90ae-411a64c292c0 req-f5d616b1-61e5-4022-9a94-7bc3c88edd3e service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-02f7c0e4-675b-4d01-90ae-411a64c292c0 req-f5d616b1-61e5-4022-9a94-7bc3c88edd3e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:56 user nova-compute[75354]: WARNING nova.compute.manager [req-02f7c0e4-675b-4d01-90ae-411a64c292c0 req-f5d616b1-61e5-4022-9a94-7bc3c88edd3e service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state active and task_state rescuing.
Nov 14 06:38:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:38:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-4566060f-e076-4d9e-9761-a16de1ee7ff3 req-40611818-c35f-47c6-9ac3-bc552d428bcf service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:38:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4566060f-e076-4d9e-9761-a16de1ee7ff3 req-40611818-c35f-47c6-9ac3-bc552d428bcf service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:38:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4566060f-e076-4d9e-9761-a16de1ee7ff3 req-40611818-c35f-47c6-9ac3-bc552d428bcf service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:38:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4566060f-e076-4d9e-9761-a16de1ee7ff3 req-40611818-c35f-47c6-9ac3-bc552d428bcf service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:38:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-4566060f-e076-4d9e-9761-a16de1ee7ff3 req-40611818-c35f-47c6-9ac3-bc552d428bcf service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:38:58 user nova-compute[75354]: WARNING nova.compute.manager [req-4566060f-e076-4d9e-9761-a16de1ee7ff3 req-40611818-c35f-47c6-9ac3-bc552d428bcf service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state active and task_state rescuing.
Nov 14 06:38:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-21c22970-81c1-4730-86fa-5ed54de26665 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:39:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:39:15 user nova-compute[75354]: INFO nova.compute.claims [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Claim successful on node user
Nov 14 06:39:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:39:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:39:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.policy [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d439693760147d2aab8152ac87480fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0829bb25ebb344eeb7cc2cfbb6990db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:39:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Creating image(s)
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "/opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "/opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk 1073741824" returned: 0 in 0.053s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Successfully created port: b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Cannot resize image /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Ensure instance console log exists: /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.neutron [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Successfully updated port: b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquired lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.neutron [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-changed-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Refreshing instance network info cache due to event network-changed-b81a0b32-9341-4b0e-8402-9c845e0975f6. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] Acquiring lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.neutron [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.neutron [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Updating instance_info_cache with network_info: [{"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Releasing lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Instance network_info: |[{"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] Acquired lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.neutron [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Refreshing network info cache for port b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Start _get_guest_xml network_info=[{"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:39:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:39:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2132560613',display_name='tempest-ServersNegativeTestJSON-server-2132560613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2132560613',id=23,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0829bb25ebb344eeb7cc2cfbb6990db0',ramdisk_id='',reservation_id='r-b85b83av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-906617313',owner_user_name='tempest-ServersNegativeTestJSON-906617313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:39:16Z,user_data=None,user_id='1d439693760147d2aab8152ac87480fa',uuid=d1a1c1bb-0d24-4cbe-8de7-cb0d837af163,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converting VIF {"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.objects.instance [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lazy-loading 'pci_devices' on Instance uuid d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:39:17 user nova-compute[75354]:   <uuid>d1a1c1bb-0d24-4cbe-8de7-cb0d837af163</uuid>
Nov 14 06:39:17 user nova-compute[75354]:   <name>instance-00000017</name>
Nov 14 06:39:17 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:39:17 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:39:17 user nova-compute[75354]:   <metadata>
Nov 14 06:39:17 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:39:17 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:39:17 user nova-compute[75354]:       <nova:name>tempest-ServersNegativeTestJSON-server-2132560613</nova:name>
Nov 14 06:39:17 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:39:17</nova:creationTime>
Nov 14 06:39:17 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:39:17 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:39:17 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:39:17 user nova-compute[75354]:       <nova:owner>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:user uuid="1d439693760147d2aab8152ac87480fa">tempest-ServersNegativeTestJSON-906617313-project-member</nova:user>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:project uuid="0829bb25ebb344eeb7cc2cfbb6990db0">tempest-ServersNegativeTestJSON-906617313</nova:project>
Nov 14 06:39:17 user nova-compute[75354]:       </nova:owner>
Nov 14 06:39:17 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:39:17 user nova-compute[75354]:       <nova:ports>
Nov 14 06:39:17 user nova-compute[75354]:         <nova:port uuid="b81a0b32-9341-4b0e-8402-9c845e0975f6">
Nov 14 06:39:17 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 06:39:17 user nova-compute[75354]:         </nova:port>
Nov 14 06:39:17 user nova-compute[75354]:       </nova:ports>
Nov 14 06:39:17 user nova-compute[75354]:     </nova:instance>
Nov 14 06:39:17 user nova-compute[75354]:   </metadata>
Nov 14 06:39:17 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:39:17 user nova-compute[75354]:     <system>
Nov 14 06:39:17 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:39:17 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:39:17 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:39:17 user nova-compute[75354]:       <entry name="serial">d1a1c1bb-0d24-4cbe-8de7-cb0d837af163</entry>
Nov 14 06:39:17 user nova-compute[75354]:       <entry name="uuid">d1a1c1bb-0d24-4cbe-8de7-cb0d837af163</entry>
Nov 14 06:39:17 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:39:17 user nova-compute[75354]:     </system>
Nov 14 06:39:17 user nova-compute[75354]:   </sysinfo>
Nov 14 06:39:17 user nova-compute[75354]:   <os>
Nov 14 06:39:17 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:39:17 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:39:17 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:39:17 user nova-compute[75354]:   </os>
Nov 14 06:39:17 user nova-compute[75354]:   <features>
Nov 14 06:39:17 user nova-compute[75354]:     <acpi/>
Nov 14 06:39:17 user nova-compute[75354]:     <apic/>
Nov 14 06:39:17 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:39:17 user nova-compute[75354]:   </features>
Nov 14 06:39:17 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:39:17 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:39:17 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:39:17 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:39:17 user nova-compute[75354]:   </clock>
Nov 14 06:39:17 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:39:17 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:39:17 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:39:17 user nova-compute[75354]:   </cpu>
Nov 14 06:39:17 user nova-compute[75354]:   <devices>
Nov 14 06:39:17 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:39:17 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:39:17 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk"/>
Nov 14 06:39:17 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:39:17 user nova-compute[75354]:     </disk>
Nov 14 06:39:17 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:39:17 user nova-compute[75354]:       <mac address="fa:16:3e:6a:d5:9d"/>
Nov 14 06:39:17 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:39:17 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:39:17 user nova-compute[75354]:       <target dev="tapb81a0b32-93"/>
Nov 14 06:39:17 user nova-compute[75354]:     </interface>
Nov 14 06:39:17 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:39:17 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/console.log" append="off"/>
Nov 14 06:39:17 user nova-compute[75354]:     </serial>
Nov 14 06:39:17 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:39:17 user nova-compute[75354]:     <video>
Nov 14 06:39:17 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:39:17 user nova-compute[75354]:     </video>
Nov 14 06:39:17 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:39:17 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:39:17 user nova-compute[75354]:     </rng>
Nov 14 06:39:17 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:39:17 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:39:17 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:39:17 user nova-compute[75354]:     </memballoon>
Nov 14 06:39:17 user nova-compute[75354]:   </devices>
Nov 14 06:39:17 user nova-compute[75354]: </domain>
Nov 14 06:39:17 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2132560613',display_name='tempest-ServersNegativeTestJSON-server-2132560613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2132560613',id=23,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0829bb25ebb344eeb7cc2cfbb6990db0',ramdisk_id='',reservation_id='r-b85b83av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-906617313',owner_user_name='tempest-ServersNegativeTestJSON-906617313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:39:16Z,user_data=None,user_id='1d439693760147d2aab8152ac87480fa',uuid=d1a1c1bb-0d24-4cbe-8de7-cb0d837af163,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converting VIF {"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG os_vif [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2964608-9500-5313-b8e3-a1f6e6791af9', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb81a0b32-93, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb81a0b32-93, col_values=(('qos', UUID('6e1ae22c-9108-49f3-8f0a-fa7e20f7515b')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb81a0b32-93, col_values=(('external_ids', {'iface-id': 'b81a0b32-9341-4b0e-8402-9c845e0975f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:d5:9d', 'vm-uuid': 'd1a1c1bb-0d24-4cbe-8de7-cb0d837af163'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:17 user nova-compute[75354]: INFO os_vif [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93')
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:39:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] No VIF found with MAC fa:16:3e:6a:d5:9d, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:39:18 user nova-compute[75354]: DEBUG nova.network.neutron [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Updated VIF entry in instance network info cache for port b81a0b32-9341-4b0e-8402-9c845e0975f6. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:39:18 user nova-compute[75354]: DEBUG nova.network.neutron [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Updating instance_info_cache with network_info: [{"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:39:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ca510d7b-57f0-446f-a8f3-8d2c66a21b54 req-da005385-9e36-4a96-82d4-3206698729e7 service nova] Releasing lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:39:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-053de5c1-37b1-4ae2-bcdb-0709c17133ab req-d5b1b51f-052b-43db-bba2-65861f915b54 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-053de5c1-37b1-4ae2-bcdb-0709c17133ab req-d5b1b51f-052b-43db-bba2-65861f915b54 service nova] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-053de5c1-37b1-4ae2-bcdb-0709c17133ab req-d5b1b51f-052b-43db-bba2-65861f915b54 service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-053de5c1-37b1-4ae2-bcdb-0709c17133ab req-d5b1b51f-052b-43db-bba2-65861f915b54 service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-053de5c1-37b1-4ae2-bcdb-0709c17133ab req-d5b1b51f-052b-43db-bba2-65861f915b54 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] No waiting events found dispatching network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:39:19 user nova-compute[75354]: WARNING nova.compute.manager [req-053de5c1-37b1-4ae2-bcdb-0709c17133ab req-d5b1b51f-052b-43db-bba2-65861f915b54 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received unexpected event network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 for instance with vm_state building and task_state spawning.
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:39:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Instance spawned successfully.
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-235fc94c-3c8e-4f9a-95bf-6be410c2324f req-af6ece68-081e-488e-a3ca-f78b60de6aea service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-235fc94c-3c8e-4f9a-95bf-6be410c2324f req-af6ece68-081e-488e-a3ca-f78b60de6aea service nova] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-235fc94c-3c8e-4f9a-95bf-6be410c2324f req-af6ece68-081e-488e-a3ca-f78b60de6aea service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-235fc94c-3c8e-4f9a-95bf-6be410c2324f req-af6ece68-081e-488e-a3ca-f78b60de6aea service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-235fc94c-3c8e-4f9a-95bf-6be410c2324f req-af6ece68-081e-488e-a3ca-f78b60de6aea service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] No waiting events found dispatching network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:39:21 user nova-compute[75354]: WARNING nova.compute.manager [req-235fc94c-3c8e-4f9a-95bf-6be410c2324f req-af6ece68-081e-488e-a3ca-f78b60de6aea service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received unexpected event network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 for instance with vm_state building and task_state spawning.
Nov 14 06:39:21 user nova-compute[75354]: INFO nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 14 06:39:21 user nova-compute[75354]: DEBUG nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:39:21 user nova-compute[75354]: INFO nova.compute.manager [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Took 6.16 seconds to build instance.
Nov 14 06:39:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-16b8ccdd-3297-4071-a75e-0391dd1750f8 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.262s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:28 user nova-compute[75354]: INFO nova.compute.manager [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Terminating instance
Nov 14 06:39:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-a33d0ef0-ae77-44b7-b0f7-d4dfc3ea9947 req-e4a054cf-bc76-48fd-bd95-f82b9d42a803 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a33d0ef0-ae77-44b7-b0f7-d4dfc3ea9947 req-e4a054cf-bc76-48fd-bd95-f82b9d42a803 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a33d0ef0-ae77-44b7-b0f7-d4dfc3ea9947 req-e4a054cf-bc76-48fd-bd95-f82b9d42a803 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a33d0ef0-ae77-44b7-b0f7-d4dfc3ea9947 req-e4a054cf-bc76-48fd-bd95-f82b9d42a803 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-a33d0ef0-ae77-44b7-b0f7-d4dfc3ea9947 req-e4a054cf-bc76-48fd-bd95-f82b9d42a803 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:39:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-a33d0ef0-ae77-44b7-b0f7-d4dfc3ea9947 req-e4a054cf-bc76-48fd-bd95-f82b9d42a803 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-unplugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:39:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Instance destroyed successfully.
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'resources' on Instance uuid 68039fc4-3444-4768-aa9e-ba1cb521b5dd {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-124393074',display_name='tempest-AttachVolumeTestJSON-server-124393074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-124393074',id=2,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhD9kNh4piyygRPDe8Ok2ITjV0POgmUGSZgMuqbp1ELt1k75WrQ368hOk9eyyvtffVDGqn878yPOBxbwrgqXF52o60RWxdov+WFDi/M+okrKq6cLR8vlTj00ssDYbXatw==',key_name='tempest-keypair-1017085558',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-piva8jga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=68039fc4-3444-4768-aa9e-ba1cb521b5dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "edb76634-c756-41ed-ace4-5b82d24b5365", "address": "fa:16:3e:1b:86:63", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb76634-c7", "ovs_interfaceid": "edb76634-c756-41ed-ace4-5b82d24b5365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG os_vif [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedb76634-c7, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32e739d0-c7ed-4f57-9d67-bd8837a64f27) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:39:29 user nova-compute[75354]: INFO os_vif [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:63,bridge_name='br-int',has_traffic_filtering=True,id=edb76634-c756-41ed-ace4-5b82d24b5365,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb76634-c7')
Nov 14 06:39:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Deleting instance files /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd_del
Nov 14 06:39:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Deletion of /opt/stack/data/nova/instances/68039fc4-3444-4768-aa9e-ba1cb521b5dd_del complete
Nov 14 06:39:29 user nova-compute[75354]: INFO nova.compute.manager [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-fd7a7086-3542-4af9-96c1-2a17e94fdda1 req-5788cfa3-5265-4451-8bd0-1789c7df6c78 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-deleted-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:39:30 user nova-compute[75354]: INFO nova.compute.manager [req-fd7a7086-3542-4af9-96c1-2a17e94fdda1 req-5788cfa3-5265-4451-8bd0-1789c7df6c78 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Neutron deleted interface edb76634-c756-41ed-ace4-5b82d24b5365; detaching it from the instance and deleting it from the info cache
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-fd7a7086-3542-4af9-96c1-2a17e94fdda1 req-5788cfa3-5265-4451-8bd0-1789c7df6c78 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:39:30 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Took 0.99 seconds to deallocate network for instance.
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-fd7a7086-3542-4af9-96c1-2a17e94fdda1 req-5788cfa3-5265-4451-8bd0-1789c7df6c78 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Detach interface failed, port_id=edb76634-c756-41ed-ace4-5b82d24b5365, reason: Instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef7c8147-3897-41d2-a698-df6aec5228e9 req-913266e6-0c30-48c2-b1ab-7bce236cc3b6 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef7c8147-3897-41d2-a698-df6aec5228e9 req-913266e6-0c30-48c2-b1ab-7bce236cc3b6 service nova] Acquiring lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef7c8147-3897-41d2-a698-df6aec5228e9 req-913266e6-0c30-48c2-b1ab-7bce236cc3b6 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef7c8147-3897-41d2-a698-df6aec5228e9 req-913266e6-0c30-48c2-b1ab-7bce236cc3b6 service nova] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef7c8147-3897-41d2-a698-df6aec5228e9 req-913266e6-0c30-48c2-b1ab-7bce236cc3b6 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] No waiting events found dispatching network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:39:30 user nova-compute[75354]: WARNING nova.compute.manager [req-ef7c8147-3897-41d2-a698-df6aec5228e9 req-913266e6-0c30-48c2-b1ab-7bce236cc3b6 service nova] [instance: 68039fc4-3444-4768-aa9e-ba1cb521b5dd] Received unexpected event network-vif-plugged-edb76634-c756-41ed-ace4-5b82d24b5365 for instance with vm_state deleted and task_state None.
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:39:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:30 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Deleted allocations for instance 68039fc4-3444-4768-aa9e-ba1cb521b5dd
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c03b3507-f232-44e6-a259-404a0c2f9587 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "68039fc4-3444-4768-aa9e-ba1cb521b5dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.533s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '68039fc4-3444-4768-aa9e-ba1cb521b5dd' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '68039fc4-3444-4768-aa9e-ba1cb521b5dd' (instance-00000002)
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:39:33 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:39:33 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:39:33 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=25.29016876220703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:39:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 73aaf228-084d-4d35-acd9-27db3536287f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 616cd639-1e6f-4bed-8cba-7da50d65a4d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 43e8f13f-dbae-4b75-a14d-f563ba912701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:39:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:39:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:39:39 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updating instance_info_cache with network_info: [{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:39:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:39:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:44 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:47 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:39:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:39:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:40:04 user nova-compute[75354]: INFO nova.compute.manager [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Rescuing
Nov 14 06:40:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:40:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-de9dd22a-1920-4ddb-aa3b-b536705aa6f7 req-575d4080-448b-469a-b563-53cbe0747a19 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-de9dd22a-1920-4ddb-aa3b-b536705aa6f7 req-575d4080-448b-469a-b563-53cbe0747a19 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-de9dd22a-1920-4ddb-aa3b-b536705aa6f7 req-575d4080-448b-469a-b563-53cbe0747a19 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-de9dd22a-1920-4ddb-aa3b-b536705aa6f7 req-575d4080-448b-469a-b563-53cbe0747a19 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-de9dd22a-1920-4ddb-aa3b-b536705aa6f7 req-575d4080-448b-469a-b563-53cbe0747a19 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:05 user nova-compute[75354]: WARNING nova.compute.manager [req-de9dd22a-1920-4ddb-aa3b-b536705aa6f7 req-575d4080-448b-469a-b563-53cbe0747a19 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state active and task_state rescuing.
Nov 14 06:40:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance destroyed successfully.
Nov 14 06:40:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Attempting a stable device rescue
Nov 14 06:40:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:40:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Creating image(s)
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "7bda81ff81b8a6ca35945faad2d9947c25b8c75c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "7bda81ff81b8a6ca35945faad2d9947c25b8c75c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.images [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] 88023755-5628-4577-961b-98fcd24b5172 was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.part /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.part /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.converted" returned: 0 in 0.382s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-22f0e593-e815-4ba1-ab9d-42873799662c req-7029f214-4610-4226-8310-2c091c28a0e0 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-22f0e593-e815-4ba1-ab9d-42873799662c req-7029f214-4610-4226-8310-2c091c28a0e0 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-22f0e593-e815-4ba1-ab9d-42873799662c req-7029f214-4610-4226-8310-2c091c28a0e0 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-22f0e593-e815-4ba1-ab9d-42873799662c req-7029f214-4610-4226-8310-2c091c28a0e0 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-22f0e593-e815-4ba1-ab9d-42873799662c req-7029f214-4610-4226-8310-2c091c28a0e0 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:07 user nova-compute[75354]: WARNING nova.compute.manager [req-22f0e593-e815-4ba1-ab9d-42873799662c req-7029f214-4610-4226-8310-2c091c28a0e0 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state active and task_state rescuing.
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "7bda81ff81b8a6ca35945faad2d9947c25b8c75c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.873s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "7bda81ff81b8a6ca35945faad2d9947c25b8c75c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "7bda81ff81b8a6ca35945faad2d9947c25b8c75c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c,backing_fmt=raw /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c,backing_fmt=raw /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "7bda81ff81b8a6ca35945faad2d9947c25b8c75c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'migration_context' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<9fa44e1b-6893-43f1-a435-3ef2fc914a1d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Start _get_guest_xml network_info=[{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "vif_mac": "fa:16:3e:5e:02:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '88023755-5628-4577-961b-98fcd24b5172', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9fa44e1b-6893-43f1-a435-3ef2fc914a1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'serial': 'c7ebef2e-f32d-4d78-bef2-473e138ca7a0'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'af4833dd-3b25-4579-a97d-3be33e8edc40', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'resources' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<9fa44e1b-6893-43f1-a435-3ef2fc914a1d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'numa_topology' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<9fa44e1b-6893-43f1-a435-3ef2fc914a1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:40:07 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:07 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:40:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.objects.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<9fa44e1b-6893-43f1-a435-3ef2fc914a1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:40:08 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:40:08 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:40:08 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e696b0-814d-4684-b042-8c00d20a7ddd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VpDBTSbx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 06:40:08 user nova-compute[75354]: node.name = iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:40:08 user nova-compute[75354]: node.tpgt = -1
Nov 14 06:40:08 user nova-compute[75354]: node.startup = automatic
Nov 14 06:40:08 user nova-compute[75354]: node.leading_login = No
Nov 14 06:40:08 user nova-compute[75354]: iface.iscsi_ifacename = default
Nov 14 06:40:08 user nova-compute[75354]: iface.net_ifacename = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.ipaddress = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.prefix_len = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.hwaddress = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.transport_name = tcp
Nov 14 06:40:08 user nova-compute[75354]: iface.initiatorname = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.vlan_id = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.vlan_priority = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.vlan_state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.iface_num = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.mtu = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.port = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.bootproto = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.subnet_mask = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.gateway = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_alt_client_id = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_dns = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_learn_iqn = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_vendor_id_state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_vendor_id = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.dhcp_slp_da = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.fragmentation = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.gratuitous_arp = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.incoming_forwarding = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.tos_state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.tos = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.ttl = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.delayed_ack = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.tcp_nagle = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.tcp_wsf_state = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.tcp_wsf = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.tcp_timer_scale = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.tcp_timestamp = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.redirect = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.def_task_mgmt_timeout = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.header_digest = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.data_digest = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.immediate_data = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.initial_r2t = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.data_seq_inorder = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.data_pdu_inorder = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.erl = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.max_receive_data_len = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.first_burst_len = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.max_outstanding_r2t = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.max_burst_len = 0
Nov 14 06:40:08 user nova-compute[75354]: iface.chap_auth = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.bidi_chap = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.strict_login_compliance = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.discovery_auth = <empty>
Nov 14 06:40:08 user nova-compute[75354]: iface.discovery_logout = <empty>
Nov 14 06:40:08 user nova-compute[75354]: node.discovery_address = <empty>
Nov 14 06:40:08 user nova-compute[75354]: node.discovery_port = 0
Nov 14 06:40:08 user nova-compute[75354]: node.discovery_type = static
Nov 14 06:40:08 user nova-compute[75354]: node.session.initial_cmdsn = 0
Nov 14 06:40:08 user nova-compute[75354]: node.session.initial_login_retry_max = 8
Nov 14 06:40:08 user nova-compute[75354]: node.session.xmit_thread_priority = -20
Nov 14 06:40:08 user nova-compute[75354]: node.session.cmds_max = 128
Nov 14 06:40:08 user nova-compute[75354]: node.session.queue_depth = 32
Nov 14 06:40:08 user nova-compute[75354]: node.session.nr_sessions = 1
Nov 14 06:40:08 user nova-compute[75354]: node.session.auth.authmethod = CHAP
Nov 14 06:40:08 user nova-compute[75354]: node.session.auth.username = VpDBTSbx
Nov 14 06:40:08 user nova-compute[75354]: node.session.auth.password = ***
Nov 14 06:40:08 user nova-compute[75354]: node.session.auth.username_in = <empty>
Nov 14 06:40:08 user nova-compute[75354]: node.session.auth.password_in = <empty>
Nov 14 06:40:08 user nova-compute[75354]: node.session.auth.chap_algs = MD5
Nov 14 06:40:08 user nova-compute[75354]: node.session.timeo.replacement_timeout = 120
Nov 14 06:40:08 user nova-compute[75354]: node.session.err_timeo.abort_timeout = 15
Nov 14 06:40:08 user nova-compute[75354]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 06:40:08 user nova-compute[75354]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 06:40:08 user nova-compute[75354]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.FastAbort = Yes
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.InitialR2T = No
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.ImmediateData = Yes
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.MaxConnections = 1
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 06:40:08 user nova-compute[75354]: node.session.iscsi.ERL = 0
Nov 14 06:40:08 user nova-compute[75354]: node.session.scan = manual
Nov 14 06:40:08 user nova-compute[75354]: node.session.reopen_max = 0
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].address = 172.16.0.220
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].port = 3260
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].startup = manual
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].tcp.window_size = 524288
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].tcp.type_of_service = 0
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].timeo.logout_timeout = 15
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].timeo.login_timeout = 15
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].timeo.auth_timeout = 45
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].iscsi.DataDigest = None
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].iscsi.IFMarker = No
Nov 14 06:40:08 user nova-compute[75354]: node.conn[0].iscsi.OFMarker = No
Nov 14 06:40:08 user nova-compute[75354]: # END RECORD
Nov 14 06:40:08 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f2271-f147-4eff-b60b-745559072f0c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32840e6a-5918-4507-9d42-3ff402afb32f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDBTSbx {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDBTSbx" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb47eb-c20f-4498-9e27-cb0abf6a34d0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpDBTSbx'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471ce50-0448-4eaf-9e30-0088b3dea2a6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44c5294-8ceb-4e4c-8d46-0a179021277c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:08 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:40:08 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:08 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:40:08 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:08 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:40:08 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:08 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:40:08 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7aa95-60b5-426b-b39d-f070190565c2]: (4, ('0 0 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '26662313435346234', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662313435346234', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740472689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740472689',id=21,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-v7lgv8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:38:31Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=9fa44e1b-6893-43f1-a435-3ef2fc914a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "vif_mac": "fa:16:3e:5e:02:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "vif_mac": "fa:16:3e:5e:02:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.objects.base [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<9fa44e1b-6893-43f1-a435-3ef2fc914a1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:40:08 user nova-compute[75354]:   <uuid>9fa44e1b-6893-43f1-a435-3ef2fc914a1d</uuid>
Nov 14 06:40:08 user nova-compute[75354]:   <name>instance-00000015</name>
Nov 14 06:40:08 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:40:08 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:40:08 user nova-compute[75354]:   <metadata>
Nov 14 06:40:08 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:40:08 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:40:08 user nova-compute[75354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1740472689</nova:name>
Nov 14 06:40:08 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:40:07</nova:creationTime>
Nov 14 06:40:08 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:40:08 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:40:08 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:40:08 user nova-compute[75354]:       <nova:owner>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:user uuid="2dfc31b05a2848128a837f170ac63b93">tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member</nova:user>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:project uuid="7e0fdd525e8a49aeac22892962d8b14e">tempest-ServerBootFromVolumeStableRescueTest-1883221150</nova:project>
Nov 14 06:40:08 user nova-compute[75354]:       </nova:owner>
Nov 14 06:40:08 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:40:08 user nova-compute[75354]:       <nova:ports>
Nov 14 06:40:08 user nova-compute[75354]:         <nova:port uuid="155db473-e304-43ef-8f72-a416833af65a">
Nov 14 06:40:08 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:40:08 user nova-compute[75354]:         </nova:port>
Nov 14 06:40:08 user nova-compute[75354]:       </nova:ports>
Nov 14 06:40:08 user nova-compute[75354]:     </nova:instance>
Nov 14 06:40:08 user nova-compute[75354]:   </metadata>
Nov 14 06:40:08 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:40:08 user nova-compute[75354]:     <system>
Nov 14 06:40:08 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:40:08 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:40:08 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:40:08 user nova-compute[75354]:       <entry name="serial">9fa44e1b-6893-43f1-a435-3ef2fc914a1d</entry>
Nov 14 06:40:08 user nova-compute[75354]:       <entry name="uuid">9fa44e1b-6893-43f1-a435-3ef2fc914a1d</entry>
Nov 14 06:40:08 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:40:08 user nova-compute[75354]:     </system>
Nov 14 06:40:08 user nova-compute[75354]:   </sysinfo>
Nov 14 06:40:08 user nova-compute[75354]:   <os>
Nov 14 06:40:08 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:40:08 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:40:08 user nova-compute[75354]:   </os>
Nov 14 06:40:08 user nova-compute[75354]:   <features>
Nov 14 06:40:08 user nova-compute[75354]:     <acpi/>
Nov 14 06:40:08 user nova-compute[75354]:     <apic/>
Nov 14 06:40:08 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:40:08 user nova-compute[75354]:   </features>
Nov 14 06:40:08 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:40:08 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:40:08 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:40:08 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:40:08 user nova-compute[75354]:   </clock>
Nov 14 06:40:08 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:40:08 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:40:08 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:40:08 user nova-compute[75354]:   </cpu>
Nov 14 06:40:08 user nova-compute[75354]:   <devices>
Nov 14 06:40:08 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:40:08 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:40:08 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 06:40:08 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:40:08 user nova-compute[75354]:       <serial>c7ebef2e-f32d-4d78-bef2-473e138ca7a0</serial>
Nov 14 06:40:08 user nova-compute[75354]:     </disk>
Nov 14 06:40:08 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:40:08 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:40:08 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue"/>
Nov 14 06:40:08 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:40:08 user nova-compute[75354]:       <boot order="1"/>
Nov 14 06:40:08 user nova-compute[75354]:     </disk>
Nov 14 06:40:08 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:40:08 user nova-compute[75354]:       <mac address="fa:16:3e:5e:02:f4"/>
Nov 14 06:40:08 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:40:08 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:40:08 user nova-compute[75354]:       <target dev="tap155db473-e3"/>
Nov 14 06:40:08 user nova-compute[75354]:     </interface>
Nov 14 06:40:08 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:40:08 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/console.log" append="off"/>
Nov 14 06:40:08 user nova-compute[75354]:     </serial>
Nov 14 06:40:08 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:40:08 user nova-compute[75354]:     <video>
Nov 14 06:40:08 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:40:08 user nova-compute[75354]:     </video>
Nov 14 06:40:08 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:40:08 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:40:08 user nova-compute[75354]:     </rng>
Nov 14 06:40:08 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:40:08 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:40:08 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:40:08 user nova-compute[75354]:     </memballoon>
Nov 14 06:40:08 user nova-compute[75354]:   </devices>
Nov 14 06:40:08 user nova-compute[75354]: </domain>
Nov 14 06:40:08 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:40:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance destroyed successfully.
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No VIF found with MAC fa:16:3e:5e:02:f4, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:08 user nova-compute[75354]: INFO nova.compute.manager [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Detaching volume 19b1e382-2814-452f-b14d-91fb9da79aee
Nov 14 06:40:09 user nova-compute[75354]: INFO nova.virt.block_device [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Attempting to driver detach volume 19b1e382-2814-452f-b14d-91fb9da79aee from mountpoint /dev/vdc
Nov 14 06:40:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Attempting to detach device vdc from instance 73aaf228-084d-4d35-acd9-27db3536287f from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:40:09 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:40:09 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:40:09 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:40:09 user nova-compute[75354]:   <serial>19b1e382-2814-452f-b14d-91fb9da79aee</serial>
Nov 14 06:40:09 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 06:40:09 user nova-compute[75354]: </disk>
Nov 14 06:40:09 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:40:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully detached device vdc from instance 73aaf228-084d-4d35-acd9-27db3536287f from the persistent domain config.
Nov 14 06:40:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 73aaf228-084d-4d35-acd9-27db3536287f from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:40:09 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:40:09 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:40:09 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:40:09 user nova-compute[75354]:   <serial>19b1e382-2814-452f-b14d-91fb9da79aee</serial>
Nov 14 06:40:09 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 06:40:09 user nova-compute[75354]: </disk>
Nov 14 06:40:09 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-79e0a730-3ab6-4747-b809-ff102df4862d req-26ee7f21-ec16-4701-8add-0a78a96e5ac3 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-79e0a730-3ab6-4747-b809-ff102df4862d req-26ee7f21-ec16-4701-8add-0a78a96e5ac3 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-79e0a730-3ab6-4747-b809-ff102df4862d req-26ee7f21-ec16-4701-8add-0a78a96e5ac3 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-79e0a730-3ab6-4747-b809-ff102df4862d req-26ee7f21-ec16-4701-8add-0a78a96e5ac3 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-79e0a730-3ab6-4747-b809-ff102df4862d req-26ee7f21-ec16-4701-8add-0a78a96e5ac3 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:10 user nova-compute[75354]: WARNING nova.compute.manager [req-79e0a730-3ab6-4747-b809-ff102df4862d req-26ee7f21-ec16-4701-8add-0a78a96e5ac3 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state active and task_state rescuing.
Nov 14 06:40:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-3cfcd8c4-b0d8-4aa6-ad51-1de504e67d6a tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:40:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-051d059e-5abd-4931-bf19-b8facf26857c req-35a6a661-5298-46ec-a335-9b6e93037366 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-051d059e-5abd-4931-bf19-b8facf26857c req-35a6a661-5298-46ec-a335-9b6e93037366 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-051d059e-5abd-4931-bf19-b8facf26857c req-35a6a661-5298-46ec-a335-9b6e93037366 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-051d059e-5abd-4931-bf19-b8facf26857c req-35a6a661-5298-46ec-a335-9b6e93037366 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-051d059e-5abd-4931-bf19-b8facf26857c req-35a6a661-5298-46ec-a335-9b6e93037366 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:12 user nova-compute[75354]: WARNING nova.compute.manager [req-051d059e-5abd-4931-bf19-b8facf26857c req-35a6a661-5298-46ec-a335-9b6e93037366 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state active and task_state rescuing.
Nov 14 06:40:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:16 user nova-compute[75354]: INFO nova.compute.manager [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Unrescuing
Nov 14 06:40:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:40:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:16 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'flavor' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-31e54157-88c8-4d13-b34f-8639c0867d52 req-64402321-5c79-4b2b-b7c5-e6d4bdd087c3 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-31e54157-88c8-4d13-b34f-8639c0867d52 req-64402321-5c79-4b2b-b7c5-e6d4bdd087c3 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-31e54157-88c8-4d13-b34f-8639c0867d52 req-64402321-5c79-4b2b-b7c5-e6d4bdd087c3 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-31e54157-88c8-4d13-b34f-8639c0867d52 req-64402321-5c79-4b2b-b7c5-e6d4bdd087c3 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-31e54157-88c8-4d13-b34f-8639c0867d52 req-64402321-5c79-4b2b-b7c5-e6d4bdd087c3 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:17 user nova-compute[75354]: WARNING nova.compute.manager [req-31e54157-88c8-4d13-b34f-8639c0867d52 req-64402321-5c79-4b2b-b7c5-e6d4bdd087c3 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance destroyed successfully.
Nov 14 06:40:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:19 user nova-compute[75354]: WARNING nova.compute.manager [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:19 user nova-compute[75354]: WARNING nova.compute.manager [req-1d502168-f1c1-49c9-938b-c91fb2b12e33 req-e00c17fb-916c-40c9-86f6-0274c86e3ff1 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-14b895d5-0bb2-4f92-a70d-f9f262632e51 req-1c6e80e8-1587-4987-8b57-94bfee0d1564 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14b895d5-0bb2-4f92-a70d-f9f262632e51 req-1c6e80e8-1587-4987-8b57-94bfee0d1564 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14b895d5-0bb2-4f92-a70d-f9f262632e51 req-1c6e80e8-1587-4987-8b57-94bfee0d1564 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-14b895d5-0bb2-4f92-a70d-f9f262632e51 req-1c6e80e8-1587-4987-8b57-94bfee0d1564 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-14b895d5-0bb2-4f92-a70d-f9f262632e51 req-1c6e80e8-1587-4987-8b57-94bfee0d1564 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:21 user nova-compute[75354]: WARNING nova.compute.manager [req-14b895d5-0bb2-4f92-a70d-f9f262632e51 req-1c6e80e8-1587-4987-8b57-94bfee0d1564 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:21 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e9ac97c9-889f-4073-a031-3a8f9ac38d8c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:40:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:22 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:40:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:22 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:40:22 user nova-compute[75354]: INFO nova.compute.claims [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Claim successful on node user
Nov 14 06:40:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:40:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.policy [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43461d505f5f44d68823f9c9e67f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809549aa1ea440abaef3e4ba37ca414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:40:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Creating image(s)
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "/opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "/opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.218s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk 1073741824" returned: 0 in 0.052s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Successfully created port: 42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Cannot resize image /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Ensure instance console log exists: /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Successfully updated port: 42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquired lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-changed-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Refreshing instance network info cache due to event network-changed-42699268-e3da-4ff4-b5f0-8e86e29b1162. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] Acquiring lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updating instance_info_cache with network_info: [{"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Releasing lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Instance network_info: |[{"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] Acquired lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.neutron [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Refreshing network info cache for port 42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Start _get_guest_xml network_info=[{"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:40:25 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:25 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2024923655',display_name='tempest-AttachVolumeTestJSON-server-2024923655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2024923655',id=24,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0YyaiK1ivkie7mmBIecrr8LatwMJZGkIjy2mXeXnpxm12deI+2uewaDmkHJUIVbqKxhQ2NRfN849cuJc669WaJVcK7ypO0pWbQEJVRsVkITsD6CNJvDtACRlf6SoeMAQ==',key_name='tempest-keypair-1822276340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-1a260eca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=f0794e7d-f909-456f-b9db-1aa833099848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'pci_devices' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:40:25 user nova-compute[75354]:   <uuid>f0794e7d-f909-456f-b9db-1aa833099848</uuid>
Nov 14 06:40:25 user nova-compute[75354]:   <name>instance-00000018</name>
Nov 14 06:40:25 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:40:25 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:40:25 user nova-compute[75354]:   <metadata>
Nov 14 06:40:25 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:40:25 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:40:25 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeTestJSON-server-2024923655</nova:name>
Nov 14 06:40:25 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:40:25</nova:creationTime>
Nov 14 06:40:25 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:40:25 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:40:25 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:40:25 user nova-compute[75354]:       <nova:owner>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:user uuid="43461d505f5f44d68823f9c9e67f1cf4">tempest-AttachVolumeTestJSON-1353209128-project-member</nova:user>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:project uuid="f809549aa1ea440abaef3e4ba37ca414">tempest-AttachVolumeTestJSON-1353209128</nova:project>
Nov 14 06:40:25 user nova-compute[75354]:       </nova:owner>
Nov 14 06:40:25 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:40:25 user nova-compute[75354]:       <nova:ports>
Nov 14 06:40:25 user nova-compute[75354]:         <nova:port uuid="42699268-e3da-4ff4-b5f0-8e86e29b1162">
Nov 14 06:40:25 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 06:40:25 user nova-compute[75354]:         </nova:port>
Nov 14 06:40:25 user nova-compute[75354]:       </nova:ports>
Nov 14 06:40:25 user nova-compute[75354]:     </nova:instance>
Nov 14 06:40:25 user nova-compute[75354]:   </metadata>
Nov 14 06:40:25 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:40:25 user nova-compute[75354]:     <system>
Nov 14 06:40:25 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:40:25 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:40:25 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:40:25 user nova-compute[75354]:       <entry name="serial">f0794e7d-f909-456f-b9db-1aa833099848</entry>
Nov 14 06:40:25 user nova-compute[75354]:       <entry name="uuid">f0794e7d-f909-456f-b9db-1aa833099848</entry>
Nov 14 06:40:25 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:40:25 user nova-compute[75354]:     </system>
Nov 14 06:40:25 user nova-compute[75354]:   </sysinfo>
Nov 14 06:40:25 user nova-compute[75354]:   <os>
Nov 14 06:40:25 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:40:25 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:40:25 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:40:25 user nova-compute[75354]:   </os>
Nov 14 06:40:25 user nova-compute[75354]:   <features>
Nov 14 06:40:25 user nova-compute[75354]:     <acpi/>
Nov 14 06:40:25 user nova-compute[75354]:     <apic/>
Nov 14 06:40:25 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:40:25 user nova-compute[75354]:   </features>
Nov 14 06:40:25 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:40:25 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:40:25 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:40:25 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:40:25 user nova-compute[75354]:   </clock>
Nov 14 06:40:25 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:40:25 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:40:25 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:40:25 user nova-compute[75354]:   </cpu>
Nov 14 06:40:25 user nova-compute[75354]:   <devices>
Nov 14 06:40:25 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:40:25 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:40:25 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk"/>
Nov 14 06:40:25 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:40:25 user nova-compute[75354]:     </disk>
Nov 14 06:40:25 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:40:25 user nova-compute[75354]:       <mac address="fa:16:3e:9e:bd:c6"/>
Nov 14 06:40:25 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:40:25 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:40:25 user nova-compute[75354]:       <target dev="tap42699268-e3"/>
Nov 14 06:40:25 user nova-compute[75354]:     </interface>
Nov 14 06:40:25 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:40:25 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/console.log" append="off"/>
Nov 14 06:40:25 user nova-compute[75354]:     </serial>
Nov 14 06:40:25 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:40:25 user nova-compute[75354]:     <video>
Nov 14 06:40:25 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:40:25 user nova-compute[75354]:     </video>
Nov 14 06:40:25 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:40:25 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:40:25 user nova-compute[75354]:     </rng>
Nov 14 06:40:25 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:40:25 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:40:25 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:40:25 user nova-compute[75354]:     </memballoon>
Nov 14 06:40:25 user nova-compute[75354]:   </devices>
Nov 14 06:40:25 user nova-compute[75354]: </domain>
Nov 14 06:40:25 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2024923655',display_name='tempest-AttachVolumeTestJSON-server-2024923655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2024923655',id=24,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0YyaiK1ivkie7mmBIecrr8LatwMJZGkIjy2mXeXnpxm12deI+2uewaDmkHJUIVbqKxhQ2NRfN849cuJc669WaJVcK7ypO0pWbQEJVRsVkITsD6CNJvDtACRlf6SoeMAQ==',key_name='tempest-keypair-1822276340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-1a260eca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=f0794e7d-f909-456f-b9db-1aa833099848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG os_vif [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39dbb632-34f9-5faf-98fa-c9bfae4b7432', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42699268-e3, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42699268-e3, col_values=(('qos', UUID('1a68f0d4-0c84-43a2-96a3-11c18e80bd8a')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42699268-e3, col_values=(('external_ids', {'iface-id': '42699268-e3da-4ff4-b5f0-8e86e29b1162', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:bd:c6', 'vm-uuid': 'f0794e7d-f909-456f-b9db-1aa833099848'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:40:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:25 user nova-compute[75354]: INFO os_vif [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3')
Nov 14 06:40:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:40:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No VIF found with MAC fa:16:3e:9e:bd:c6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:40:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updated VIF entry in instance network info cache for port 42699268-e3da-4ff4-b5f0-8e86e29b1162. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:40:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updating instance_info_cache with network_info: [{"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5bdd5d46-adc4-4e67-ac5e-a940a1b150af req-8bf9bd5f-0dc6-4cd5-9c74-4a15d8290103 service nova] Releasing lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ac1c496-1295-49d1-b9be-05dd73426222 req-37847451-e5d6-4380-90c6-8fa9235b8902 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ac1c496-1295-49d1-b9be-05dd73426222 req-37847451-e5d6-4380-90c6-8fa9235b8902 service nova] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ac1c496-1295-49d1-b9be-05dd73426222 req-37847451-e5d6-4380-90c6-8fa9235b8902 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ac1c496-1295-49d1-b9be-05dd73426222 req-37847451-e5d6-4380-90c6-8fa9235b8902 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ac1c496-1295-49d1-b9be-05dd73426222 req-37847451-e5d6-4380-90c6-8fa9235b8902 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] No waiting events found dispatching network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:27 user nova-compute[75354]: WARNING nova.compute.manager [req-4ac1c496-1295-49d1-b9be-05dd73426222 req-37847451-e5d6-4380-90c6-8fa9235b8902 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received unexpected event network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 for instance with vm_state building and task_state spawning.
Nov 14 06:40:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 73aaf228-084d-4d35-acd9-27db3536287f is timed out.
Nov 14 06:40:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully detached device vdc from instance 73aaf228-084d-4d35-acd9-27db3536287f from the live domain config.
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UafMzuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:40:29 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dcb833-e41f-42b0-a508-162c8b354e66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:40:29 user nova-compute[75354]: No targets found.
Nov 14 06:40:29 user nova-compute[75354]: iSNS:
Nov 14 06:40:29 user nova-compute[75354]: No targets found.
Nov 14 06:40:29 user nova-compute[75354]: STATIC:
Nov 14 06:40:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee
Nov 14 06:40:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:40:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:40:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:40:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:29 user nova-compute[75354]: FIRMWARE:
Nov 14 06:40:29 user nova-compute[75354]: No targets found.
Nov 14 06:40:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:40:29 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:40:29 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:40:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Instance spawned successfully.
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c1fe3-434e-4db2-8fbf-801a5287f529]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-86928b18-4512-48cc-97eb-0b3bbb592f50 req-269c4ac3-9653-4af5-91c8-e3928ec19df8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-86928b18-4512-48cc-97eb-0b3bbb592f50 req-269c4ac3-9653-4af5-91c8-e3928ec19df8 service nova] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-86928b18-4512-48cc-97eb-0b3bbb592f50 req-269c4ac3-9653-4af5-91c8-e3928ec19df8 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-86928b18-4512-48cc-97eb-0b3bbb592f50 req-269c4ac3-9653-4af5-91c8-e3928ec19df8 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-86928b18-4512-48cc-97eb-0b3bbb592f50 req-269c4ac3-9653-4af5-91c8-e3928ec19df8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] No waiting events found dispatching network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:29 user nova-compute[75354]: WARNING nova.compute.manager [req-86928b18-4512-48cc-97eb-0b3bbb592f50 req-269c4ac3-9653-4af5-91c8-e3928ec19df8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received unexpected event network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 for instance with vm_state building and task_state spawning.
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2635db4-9d77-497d-b111-80951977f5e2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:29 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:40:29 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:29 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:40:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:29 user nova-compute[75354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee (non-flash)
Nov 14 06:40:29 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:29 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:40:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074216b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d926915-fe16-45dd-ab70-3a5d8274a36d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e6efd-921b-4f84-b620-66ad2e050694]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc55af-a406-4333-a87a-4e9af333cf39]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:40:29 user nova-compute[75354]: INFO nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe48d21-1982-4df6-8c72-bdd0ba07ddb3]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f509fbf-a202-49e0-80c6-6cfdbbe729ac]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: INFO nova.compute.manager [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Took 7.06 seconds to build instance.
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c665fecc-0ed6-4d03-9f74-a47e028cc8f3]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260]
Nov 14 06:40:29 user nova-compute[75354]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee, portal: 172.16.0.220,3260] successful.
Nov 14 06:40:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bc42e63-9048-4806-8151-1534fc21e22c tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.210s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b1e382-2814-452f-b14d-91fb9da79aee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c77b87-4886-473e-a9e1-21f637aa4220]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] <== disconnect_volume: return (373ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:40:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:40:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:30 user nova-compute[75354]: DEBUG nova.objects.instance [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'flavor' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-423bfa67-5fc2-4692-b933-7dd0126fd152 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.048s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:40:31 user nova-compute[75354]: INFO nova.compute.claims [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Claim successful on node user
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.427s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:40:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.policy [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4616257fc4344844a8a7913673ae0a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85018ee44225437ab1d8b96c5fa4c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:40:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Creating image(s)
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing instance network info cache due to event network-changed-889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] Acquiring lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] Acquired lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Refreshing network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:32 user nova-compute[75354]: INFO nova.compute.manager [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Terminating instance
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.compute.manager [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.205s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.208s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk 1073741824" returned: 0 in 0.063s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Cannot resize image /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Ensure instance console log exists: /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Instance destroyed successfully.
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lazy-loading 'resources' on Instance uuid 616cd639-1e6f-4bed-8cba-7da50d65a4d6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2003753906',display_name='tempest-TestShelveInstance-server-2003753906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2003753906',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+xkObWm0gP6pbiax4KJmPMne8Cjeb+Ks9EthgdyaDozYtxbVfp17rzTIU/i2zP6ul08alPIhgqvZeBPR4hOTQy/3lBA5dtT2s4aJNMg5U4BtVFfohCoMRmivNTMlfT8g==',key_name='tempest-TestShelveInstance-578191332',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1cd9f605474fe8a451637996110491',ramdisk_id='',reservation_id='r-0eh2op4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1170608310',owner_user_name='tempest-TestShelveInstance-1170608310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:38:55Z,user_data=None,user_id='61fe146c06734be7a7039cb754015019',uuid=616cd639-1e6f-4bed-8cba-7da50d65a4d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:40:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converting VIF {"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_vif [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap889d4a14-a0, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a43f3405-d847-4266-b8df-c0c4dc3dda28) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:33 user nova-compute[75354]: INFO os_vif [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:80:e5,bridge_name='br-int',has_traffic_filtering=True,id=889d4a14-a052-4bea-91b7-639f6fd83e58,network=Network(16604d69-869b-4cd2-8f2d-7e4c01c8689d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889d4a14-a0')
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaXNJxcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:40:33 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5212c2d-07cd-41f0-b1ce-644ac8ac66fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:40:33 user nova-compute[75354]: No targets found.
Nov 14 06:40:33 user nova-compute[75354]: iSNS:
Nov 14 06:40:33 user nova-compute[75354]: No targets found.
Nov 14 06:40:33 user nova-compute[75354]: STATIC:
Nov 14 06:40:33 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:40:33 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:33 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:33 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02
Nov 14 06:40:33 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:33 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:33 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:40:33 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:40:33 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:40:33 user nova-compute[75354]: FIRMWARE:
Nov 14 06:40:33 user nova-compute[75354]: No targets found.
Nov 14 06:40:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:40:33 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:40:33 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[755021ca-7ede-4c52-b99d-5bab6105596b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[851cd5b5-ba6b-43ca-bf7f-06983fd0bfb7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:33 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:33 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:40:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:33 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:33 user nova-compute[75354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 (non-flash)
Nov 14 06:40:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80987cd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aecc40-84c1-41a2-813a-b136f757692c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updated VIF entry in instance network info cache for port 889d4a14-a052-4bea-91b7-639f6fd83e58. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [{"id": "889d4a14-a052-4bea-91b7-639f6fd83e58", "address": "fa:16:3e:8d:80:e5", "network": {"id": "16604d69-869b-4cd2-8f2d-7e4c01c8689d", "bridge": "br-int", "label": "tempest-TestShelveInstance-980218957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1cd9f605474fe8a451637996110491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889d4a14-a0", "ovs_interfaceid": "889d4a14-a052-4bea-91b7-639f6fd83e58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb8d4a1-2333-4058-873f-d1782adf6944]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89341f-d331-4292-9888-59e0be4334ca]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6a9a5bdb-014a-44f6-9076-1b4e9be10a8d req-fb88c7e7-2760-451a-acd5-e943c60784da service nova] Releasing lock "refresh_cache-616cd639-1e6f-4bed-8cba-7da50d65a4d6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7269308d-9950-41f9-a6ce-10a2528ee25f]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Successfully created port: b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df1b31f-526a-4379-8291-f8e9b0b2ae65]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393dbec-91d6-4e3d-ac63-9063f732524d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260]
Nov 14 06:40:33 user nova-compute[75354]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02, portal: 172.16.0.220,3260] successful.
Nov 14 06:40:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e86fa27-bf93-42c5-8dd9-45e429842a02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c901e-94b9-4e9e-92fc-4ff21e5e2b3e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] <== disconnect_volume: return (445ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:40:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Deleting instance files /opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6_del
Nov 14 06:40:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Deletion of /opt/stack/data/nova/instances/616cd639-1e6f-4bed-8cba-7da50d65a4d6_del complete
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: INFO nova.compute.manager [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-unplugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-unplugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-unplugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Acquiring lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] No waiting events found dispatching network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:34 user nova-compute[75354]: WARNING nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received unexpected event network-vif-plugged-889d4a14-a052-4bea-91b7-639f6fd83e58 for instance with vm_state active and task_state deleting.
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-changed-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Refreshing instance network info cache due to event network-changed-5d061eec-f1c9-4dc0-942e-952053f85720. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Acquiring lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Acquired lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Refreshing network info cache for port 5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Successfully updated port: b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquired lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-changed-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Refreshing instance network info cache due to event network-changed-b86aea79-d2dd-4944-8e2e-23b4a28fead6. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] Acquiring lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:34 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Took 0.80 seconds to deallocate network for instance.
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updated VIF entry in instance network info cache for port 5d061eec-f1c9-4dc0-942e-952053f85720. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updating instance_info_cache with network_info: [{"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1b1d40a7-cd06-4421-8964-39cc4b479f3b req-6d6e7aa1-1b00-45d1-b8f8-c787ac704e1b service nova] Releasing lock "refresh_cache-43e8f13f-dbae-4b75-a14d-f563ba912701" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating instance_info_cache with network_info: [{"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Releasing lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance network_info: |[{"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] Acquired lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Refreshing network info cache for port b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Start _get_guest_xml network_info=[{"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:40:34 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:34 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1145897967',display_name='tempest-tempest.common.compute-instance-1145897967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1145897967',id=25,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPbmueRvQCp8NqHkCrl+yrPwaxMxP5J2NT2Vaf31oFT1IvlI4SpRwbDbYwalpjGLQ42o8e/fTVcgQdeljAR+QqIS0S6/rg56+UP5l+gTokPzLjG1IO6wP/2PyM7b0XJmw==',key_name='tempest-keypair-1203834143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-cerjhtt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=240cd94c-cfe6-47a0-a57e-90fd1266c7b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.objects.instance [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'pci_devices' on Instance uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:40:34 user nova-compute[75354]:   <uuid>240cd94c-cfe6-47a0-a57e-90fd1266c7b5</uuid>
Nov 14 06:40:34 user nova-compute[75354]:   <name>instance-00000019</name>
Nov 14 06:40:34 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:40:34 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:40:34 user nova-compute[75354]:   <metadata>
Nov 14 06:40:34 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:40:34 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:40:34 user nova-compute[75354]:       <nova:name>tempest-tempest.common.compute-instance-1145897967</nova:name>
Nov 14 06:40:34 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:40:34</nova:creationTime>
Nov 14 06:40:34 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:40:34 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:40:34 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:40:34 user nova-compute[75354]:       <nova:owner>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:user uuid="4616257fc4344844a8a7913673ae0a6a">tempest-ServerActionsTestOtherA-834998162-project-member</nova:user>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:project uuid="85018ee44225437ab1d8b96c5fa4c408">tempest-ServerActionsTestOtherA-834998162</nova:project>
Nov 14 06:40:34 user nova-compute[75354]:       </nova:owner>
Nov 14 06:40:34 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:40:34 user nova-compute[75354]:       <nova:ports>
Nov 14 06:40:34 user nova-compute[75354]:         <nova:port uuid="b86aea79-d2dd-4944-8e2e-23b4a28fead6">
Nov 14 06:40:34 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:40:34 user nova-compute[75354]:         </nova:port>
Nov 14 06:40:34 user nova-compute[75354]:       </nova:ports>
Nov 14 06:40:34 user nova-compute[75354]:     </nova:instance>
Nov 14 06:40:34 user nova-compute[75354]:   </metadata>
Nov 14 06:40:34 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:40:34 user nova-compute[75354]:     <system>
Nov 14 06:40:34 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:40:34 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:40:34 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:40:34 user nova-compute[75354]:       <entry name="serial">240cd94c-cfe6-47a0-a57e-90fd1266c7b5</entry>
Nov 14 06:40:34 user nova-compute[75354]:       <entry name="uuid">240cd94c-cfe6-47a0-a57e-90fd1266c7b5</entry>
Nov 14 06:40:34 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:40:34 user nova-compute[75354]:     </system>
Nov 14 06:40:34 user nova-compute[75354]:   </sysinfo>
Nov 14 06:40:34 user nova-compute[75354]:   <os>
Nov 14 06:40:34 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:40:34 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:40:34 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:40:34 user nova-compute[75354]:   </os>
Nov 14 06:40:34 user nova-compute[75354]:   <features>
Nov 14 06:40:34 user nova-compute[75354]:     <acpi/>
Nov 14 06:40:34 user nova-compute[75354]:     <apic/>
Nov 14 06:40:34 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:40:34 user nova-compute[75354]:   </features>
Nov 14 06:40:34 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:40:34 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:40:34 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:40:34 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:40:34 user nova-compute[75354]:   </clock>
Nov 14 06:40:34 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:40:34 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:40:34 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:40:34 user nova-compute[75354]:   </cpu>
Nov 14 06:40:34 user nova-compute[75354]:   <devices>
Nov 14 06:40:34 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:40:34 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:40:34 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk"/>
Nov 14 06:40:34 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:40:34 user nova-compute[75354]:     </disk>
Nov 14 06:40:34 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:40:34 user nova-compute[75354]:       <mac address="fa:16:3e:b4:90:8b"/>
Nov 14 06:40:34 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:40:34 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:40:34 user nova-compute[75354]:       <target dev="tapb86aea79-d2"/>
Nov 14 06:40:34 user nova-compute[75354]:     </interface>
Nov 14 06:40:34 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:40:34 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/console.log" append="off"/>
Nov 14 06:40:34 user nova-compute[75354]:     </serial>
Nov 14 06:40:34 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:40:34 user nova-compute[75354]:     <video>
Nov 14 06:40:34 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:40:34 user nova-compute[75354]:     </video>
Nov 14 06:40:34 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:40:34 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:40:34 user nova-compute[75354]:     </rng>
Nov 14 06:40:34 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:40:34 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:40:34 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:40:34 user nova-compute[75354]:     </memballoon>
Nov 14 06:40:34 user nova-compute[75354]:   </devices>
Nov 14 06:40:34 user nova-compute[75354]: </domain>
Nov 14 06:40:34 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1145897967',display_name='tempest-tempest.common.compute-instance-1145897967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1145897967',id=25,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPbmueRvQCp8NqHkCrl+yrPwaxMxP5J2NT2Vaf31oFT1IvlI4SpRwbDbYwalpjGLQ42o8e/fTVcgQdeljAR+QqIS0S6/rg56+UP5l+gTokPzLjG1IO6wP/2PyM7b0XJmw==',key_name='tempest-keypair-1203834143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-cerjhtt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=240cd94c-cfe6-47a0-a57e-90fd1266c7b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG os_vif [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaf92334-86a0-52aa-8817-472cfa4c02b1', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb86aea79-d2, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb86aea79-d2, col_values=(('qos', UUID('d3c8f78f-935b-4dbf-9de5-e45db74f98cb')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb86aea79-d2, col_values=(('external_ids', {'iface-id': 'b86aea79-d2dd-4944-8e2e-23b4a28fead6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:90:8b', 'vm-uuid': '240cd94c-cfe6-47a0-a57e-90fd1266c7b5'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:34 user nova-compute[75354]: INFO os_vif [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2')
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:40:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No VIF found with MAC fa:16:3e:b4:90:8b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'flavor' on Instance uuid 43e8f13f-dbae-4b75-a14d-f563ba912701 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Ignoring supplied device name: /dev/vdb
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updated VIF entry in instance network info cache for port b86aea79-d2dd-4944-8e2e-23b4a28fead6. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating instance_info_cache with network_info: [{"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8e4d25d6-63bd-4632-9d33-b70a26f7b39d req-1f501cdd-59db-40df-b492-fd44f89e982b service nova] Releasing lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: INFO nova.compute.manager [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Took 0.87 seconds to detach 1 volumes for instance.
Nov 14 06:40:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Deleting volume: 2e86fa27-bf93-42c5-8dd9-45e429842a02 {{(pid=75354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:35 user nova-compute[75354]: INFO nova.compute.manager [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Attaching volume df977bdf-ab73-4032-baee-632c7402877c to /dev/vdb
Nov 14 06:40:35 user nova-compute[75354]: DEBUG os_brick.utils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2066a67-f88e-4ec2-9461-1d46be3182b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6460d6fc-547f-48fe-ac12-e39d7dc1346c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f039c762-2708-41f8-a974-7892f05cda04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b39f1d8-8fb0-45b9-b841-f47f843174fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:40:35 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d652bf98-1eba-446c-840d-3c98e83d9a62]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG os_brick.utils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updating existing volume attachment record: 46173b13-c73e-408c-8a0b-66448bb8589f {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:35 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:36 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Deleted allocations for instance 616cd639-1e6f-4bed-8cba-7da50d65a4d6
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-812a1b2c-257e-4f92-a98d-42cc2ec9e412 tempest-TestShelveInstance-1170608310 tempest-TestShelveInstance-1170608310-project-member] Lock "616cd639-1e6f-4bed-8cba-7da50d65a4d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.242s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG nova.compute.manager [req-cdbc1343-7446-4761-a4d8-ac3cd33d5be3 req-06f84ebf-0320-4a4f-8602-616c76d89424 service nova] [instance: 616cd639-1e6f-4bed-8cba-7da50d65a4d6] Received event network-vif-deleted-889d4a14-a052-4bea-91b7-639f6fd83e58 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:36 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '616cd639-1e6f-4bed-8cba-7da50d65a4d6' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '616cd639-1e6f-4bed-8cba-7da50d65a4d6' (instance-00000012)
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:37 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:37 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7513MB free_disk=25.18366241455078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 73aaf228-084d-4d35-acd9-27db3536287f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 43e8f13f-dbae-4b75-a14d-f563ba912701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance f0794e7d-f909-456f-b9db-1aa833099848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:40:37 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:38 user nova-compute[75354]: WARNING nova.compute.manager [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state building and task_state spawning.
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:38 user nova-compute[75354]: WARNING nova.compute.manager [req-b0e46c5e-e858-4454-a029-e3439422a6b5 req-3c725a63-f139-4256-8ef5-e583160dec2c service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state building and task_state spawning.
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:40:38 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance spawned successfully.
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:40:38 user nova-compute[75354]: INFO nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 14 06:40:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:40:38 user nova-compute[75354]: INFO nova.compute.manager [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Took 7.82 seconds to build instance.
Nov 14 06:40:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53543d90-9bdc-4881-835e-d87170b98e00 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.953s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOERPmqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:40:40 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:40:40 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:40:40 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d816a1-9c2e-4e8e-99f4-33853fa5008c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:40:40 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1f7b5-cd00-4d6e-b179-4c339bfad827]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c] added
Nov 14 06:40:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245e360-5492-49a0-b9aa-aee97bec24d0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ff9b4-4f3c-482c-8bbb-afe91360a238]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOERPmqs {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOERPmqs" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[52845e11-67d7-403a-980a-d4f2169d1094]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOERPmqs'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f0b240-434e-445d-8b78-f3a5706e8471]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df4a28-fef3-4995-962c-0dba1e365eec]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[552826c8-13ec-43da-b0fb-0ec294110dc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260]
Nov 14 06:40:40 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260] successful.
Nov 14 06:40:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d72f8be-d154-4d9e-9421-97c981893fe2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd144b-55af-4768-a71a-83dd2353f7ea]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c (non-flash)
Nov 14 06:40:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:40:40 user nova-compute[75354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c (non-flash)
Nov 14 06:40:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a94dee-09dd-47d1-a5ff-e631f4f46c82]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:40:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOERPmqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:40:41 user nova-compute[75354]: INFO nova.compute.manager [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Unrescuing
Nov 14 06:40:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26566613162613932', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566613162613932', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'flavor' on Instance uuid 43e8f13f-dbae-4b75-a14d-f563ba912701 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:40:41 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:40:41 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:40:41 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:40:41 user nova-compute[75354]:   <serial>df977bdf-ab73-4032-baee-632c7402877c</serial>
Nov 14 06:40:41 user nova-compute[75354]: </disk>
Nov 14 06:40:41 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'flavor' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No VIF found with MAC fa:16:3e:9f:71:99, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-3e63650b-a8a8-4000-ae46-dd34d85f22b9 req-a2df0620-2874-4d31-b14e-37bb688f4177 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3e63650b-a8a8-4000-ae46-dd34d85f22b9 req-a2df0620-2874-4d31-b14e-37bb688f4177 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3e63650b-a8a8-4000-ae46-dd34d85f22b9 req-a2df0620-2874-4d31-b14e-37bb688f4177 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3e63650b-a8a8-4000-ae46-dd34d85f22b9 req-a2df0620-2874-4d31-b14e-37bb688f4177 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-3e63650b-a8a8-4000-ae46-dd34d85f22b9 req-a2df0620-2874-4d31-b14e-37bb688f4177 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:42 user nova-compute[75354]: WARNING nova.compute.manager [req-3e63650b-a8a8-4000-ae46-dd34d85f22b9 req-a2df0620-2874-4d31-b14e-37bb688f4177 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b43dc90a-e6be-4b77-9f74-5cb9b1da6a6f tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.163s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing instance network info cache due to event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:40:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance destroyed successfully.
Nov 14 06:40:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:43 user nova-compute[75354]: DEBUG nova.network.neutron [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updated VIF entry in instance network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:40:43 user nova-compute[75354]: DEBUG nova.network.neutron [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-df39bcec-c7a9-435a-a7ff-081f98282a3b req-8422a9c8-ecbc-47c4-bfc2-9100641e677a service nova] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-288c4b6c-ed0a-457b-b505-cf8985ca14bf req-1da299d0-835b-457a-9248-b56dd1f9c65b service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-288c4b6c-ed0a-457b-b505-cf8985ca14bf req-1da299d0-835b-457a-9248-b56dd1f9c65b service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-288c4b6c-ed0a-457b-b505-cf8985ca14bf req-1da299d0-835b-457a-9248-b56dd1f9c65b service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-288c4b6c-ed0a-457b-b505-cf8985ca14bf req-1da299d0-835b-457a-9248-b56dd1f9c65b service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-288c4b6c-ed0a-457b-b505-cf8985ca14bf req-1da299d0-835b-457a-9248-b56dd1f9c65b service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:44 user nova-compute[75354]: WARNING nova.compute.manager [req-288c4b6c-ed0a-457b-b505-cf8985ca14bf req-1da299d0-835b-457a-9248-b56dd1f9c65b service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [{"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-73aaf228-084d-4d35-acd9-27db3536287f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing instance network info cache due to event network-changed-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:40:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Refreshing network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updated VIF entry in instance network info cache for port b8ea2ee8-43e9-42bc-96d1-aa78c39beca1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:40:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e153c852-a7a3-4fa1-a532-3b1391f8dbe2 req-8eba9394-2849-48eb-a9d6-7d9f61663595 service nova] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:46 user nova-compute[75354]: WARNING nova.compute.manager [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:46 user nova-compute[75354]: WARNING nova.compute.manager [req-a8f39f98-ce34-4298-b447-34c81b2dfb33 req-db41a82b-0fa6-43e9-815e-67f52b5504c0 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:40:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-02bf7333-525a-4a9e-84a9-43cdf226ea61 tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:40:47 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 06:40:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 06:40:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:40:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:50 user nova-compute[75354]: INFO nova.compute.manager [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Detaching volume df977bdf-ab73-4032-baee-632c7402877c
Nov 14 06:40:50 user nova-compute[75354]: INFO nova.virt.block_device [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Attempting to driver detach volume df977bdf-ab73-4032-baee-632c7402877c from mountpoint /dev/vdb
Nov 14 06:40:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Attempting to detach device vdb from instance 43e8f13f-dbae-4b75-a14d-f563ba912701 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:40:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:40:50 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:40:50 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:40:50 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:40:50 user nova-compute[75354]:   <serial>df977bdf-ab73-4032-baee-632c7402877c</serial>
Nov 14 06:40:50 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:40:50 user nova-compute[75354]: </disk>
Nov 14 06:40:50 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:40:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:50 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully detached device vdb from instance 43e8f13f-dbae-4b75-a14d-f563ba912701 from the persistent domain config.
Nov 14 06:40:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43e8f13f-dbae-4b75-a14d-f563ba912701 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:40:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:40:50 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:40:50 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:40:50 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:40:50 user nova-compute[75354]:   <serial>df977bdf-ab73-4032-baee-632c7402877c</serial>
Nov 14 06:40:50 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:40:50 user nova-compute[75354]: </disk>
Nov 14 06:40:50 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:40:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43e8f13f-dbae-4b75-a14d-f563ba912701 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:40:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:59 user nova-compute[75354]: INFO nova.compute.manager [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Terminating instance
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-10f78d57-15a4-4609-9095-a62a0cc7c277 req-dad18a80-c65a-4cf5-a1c5-dfccde25a413 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-unplugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-10f78d57-15a4-4609-9095-a62a0cc7c277 req-dad18a80-c65a-4cf5-a1c5-dfccde25a413 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-10f78d57-15a4-4609-9095-a62a0cc7c277 req-dad18a80-c65a-4cf5-a1c5-dfccde25a413 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-10f78d57-15a4-4609-9095-a62a0cc7c277 req-dad18a80-c65a-4cf5-a1c5-dfccde25a413 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-10f78d57-15a4-4609-9095-a62a0cc7c277 req-dad18a80-c65a-4cf5-a1c5-dfccde25a413 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-unplugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-10f78d57-15a4-4609-9095-a62a0cc7c277 req-dad18a80-c65a-4cf5-a1c5-dfccde25a413 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-unplugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Instance destroyed successfully.
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'resources' on Instance uuid 73aaf228-084d-4d35-acd9-27db3536287f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1340763703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1340763703',id=17,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmsF02ZEXdbuk9QCs7SA/txSVRgC3Oz0qX28z3E+1APothIULTiSmML0bF6mbyk32onsnJxKlsAmJGE2meQznKvtpPz0DI2w9hD7BN5iYM6qZPE2ASG0nBwBiy1nlRxFA==',key_name='tempest-keypair-1770135778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-yfqwzrrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=73aaf228-084d-4d35-acd9-27db3536287f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "address": "fa:16:3e:1c:f3:d6", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4861783a-e4", "ovs_interfaceid": "4861783a-e44a-4b1b-9edb-016d3d2cf8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG os_vif [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:40:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4861783a-e4, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a729aff6-ae6a-4aa1-b78a-d45395e1940b) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:41:00 user nova-compute[75354]: INFO os_vif [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:f3:d6,bridge_name='br-int',has_traffic_filtering=True,id=4861783a-e44a-4b1b-9edb-016d3d2cf8ef,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4861783a-e4')
Nov 14 06:41:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Deleting instance files /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f_del
Nov 14 06:41:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Deletion of /opt/stack/data/nova/instances/73aaf228-084d-4d35-acd9-27db3536287f_del complete
Nov 14 06:41:00 user nova-compute[75354]: INFO nova.compute.manager [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 14 06:41:00 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:41:00 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:01 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Took 0.79 seconds to deallocate network for instance.
Nov 14 06:41:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-084ff929-3eb0-45c5-8c45-940b07b6672f req-0ca7d3cc-9f8e-4f53-b17d-0a521432b75c service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-deleted-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:01 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Deleted allocations for instance 73aaf228-084d-4d35-acd9-27db3536287f
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8fa10131-3d56-4838-87f0-d751a70c7f37 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "73aaf228-084d-4d35-acd9-27db3536287f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-26f909e8-3aeb-4ce9-b4e7-3ac1460a5306 req-35370943-dd34-4f72-a080-1bc9f5cd2992 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26f909e8-3aeb-4ce9-b4e7-3ac1460a5306 req-35370943-dd34-4f72-a080-1bc9f5cd2992 service nova] Acquiring lock "73aaf228-084d-4d35-acd9-27db3536287f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26f909e8-3aeb-4ce9-b4e7-3ac1460a5306 req-35370943-dd34-4f72-a080-1bc9f5cd2992 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26f909e8-3aeb-4ce9-b4e7-3ac1460a5306 req-35370943-dd34-4f72-a080-1bc9f5cd2992 service nova] Lock "73aaf228-084d-4d35-acd9-27db3536287f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-26f909e8-3aeb-4ce9-b4e7-3ac1460a5306 req-35370943-dd34-4f72-a080-1bc9f5cd2992 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] No waiting events found dispatching network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:01 user nova-compute[75354]: WARNING nova.compute.manager [req-26f909e8-3aeb-4ce9-b4e7-3ac1460a5306 req-35370943-dd34-4f72-a080-1bc9f5cd2992 service nova] [instance: 73aaf228-084d-4d35-acd9-27db3536287f] Received unexpected event network-vif-plugged-4861783a-e44a-4b1b-9edb-016d3d2cf8ef for instance with vm_state deleted and task_state None.
Nov 14 06:41:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:41:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:06 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:41:06 user nova-compute[75354]: INFO nova.compute.claims [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Claim successful on node user
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:41:07 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.policy [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d439693760147d2aab8152ac87480fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0829bb25ebb344eeb7cc2cfbb6990db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:41:07 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Creating image(s)
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "/opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "/opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "/opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.201s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk 1073741824" returned: 0 in 0.058s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Successfully created port: fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Cannot resize image /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Ensure instance console log exists: /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Successfully updated port: fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "refresh_cache-d41a9954-e03a-42ce-bf0c-0ef7db1712c6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquired lock "refresh_cache-d41a9954-e03a-42ce-bf0c-0ef7db1712c6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-changed-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Refreshing instance network info cache due to event network-changed-fb6f1139-c130-4cd6-bd14-08d1c900353d. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] Acquiring lock "refresh_cache-d41a9954-e03a-42ce-bf0c-0ef7db1712c6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.neutron [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Updating instance_info_cache with network_info: [{"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Releasing lock "refresh_cache-d41a9954-e03a-42ce-bf0c-0ef7db1712c6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Instance network_info: |[{"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] Acquired lock "refresh_cache-d41a9954-e03a-42ce-bf0c-0ef7db1712c6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.neutron [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Refreshing network info cache for port fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Start _get_guest_xml network_info=[{"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:41:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1826004795',display_name='tempest-ServersNegativeTestJSON-server-1826004795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1826004795',id=26,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0829bb25ebb344eeb7cc2cfbb6990db0',ramdisk_id='',reservation_id='r-hcg8kfdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-906617313',owner_user_name='tempest-ServersNegativeTestJSON-906617313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:41:08Z,user_data=None,user_id='1d439693760147d2aab8152ac87480fa',uuid=d41a9954-e03a-42ce-bf0c-0ef7db1712c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converting VIF {"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.objects.instance [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lazy-loading 'pci_devices' on Instance uuid d41a9954-e03a-42ce-bf0c-0ef7db1712c6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:41:09 user nova-compute[75354]:   <uuid>d41a9954-e03a-42ce-bf0c-0ef7db1712c6</uuid>
Nov 14 06:41:09 user nova-compute[75354]:   <name>instance-0000001a</name>
Nov 14 06:41:09 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:41:09 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:41:09 user nova-compute[75354]:   <metadata>
Nov 14 06:41:09 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:41:09 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:41:09 user nova-compute[75354]:       <nova:name>tempest-ServersNegativeTestJSON-server-1826004795</nova:name>
Nov 14 06:41:09 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:41:09</nova:creationTime>
Nov 14 06:41:09 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:41:09 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:41:09 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:41:09 user nova-compute[75354]:       <nova:owner>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:user uuid="1d439693760147d2aab8152ac87480fa">tempest-ServersNegativeTestJSON-906617313-project-member</nova:user>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:project uuid="0829bb25ebb344eeb7cc2cfbb6990db0">tempest-ServersNegativeTestJSON-906617313</nova:project>
Nov 14 06:41:09 user nova-compute[75354]:       </nova:owner>
Nov 14 06:41:09 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:41:09 user nova-compute[75354]:       <nova:ports>
Nov 14 06:41:09 user nova-compute[75354]:         <nova:port uuid="fb6f1139-c130-4cd6-bd14-08d1c900353d">
Nov 14 06:41:09 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 06:41:09 user nova-compute[75354]:         </nova:port>
Nov 14 06:41:09 user nova-compute[75354]:       </nova:ports>
Nov 14 06:41:09 user nova-compute[75354]:     </nova:instance>
Nov 14 06:41:09 user nova-compute[75354]:   </metadata>
Nov 14 06:41:09 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:41:09 user nova-compute[75354]:     <system>
Nov 14 06:41:09 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:41:09 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:41:09 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:41:09 user nova-compute[75354]:       <entry name="serial">d41a9954-e03a-42ce-bf0c-0ef7db1712c6</entry>
Nov 14 06:41:09 user nova-compute[75354]:       <entry name="uuid">d41a9954-e03a-42ce-bf0c-0ef7db1712c6</entry>
Nov 14 06:41:09 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:41:09 user nova-compute[75354]:     </system>
Nov 14 06:41:09 user nova-compute[75354]:   </sysinfo>
Nov 14 06:41:09 user nova-compute[75354]:   <os>
Nov 14 06:41:09 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:41:09 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:41:09 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:41:09 user nova-compute[75354]:   </os>
Nov 14 06:41:09 user nova-compute[75354]:   <features>
Nov 14 06:41:09 user nova-compute[75354]:     <acpi/>
Nov 14 06:41:09 user nova-compute[75354]:     <apic/>
Nov 14 06:41:09 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:41:09 user nova-compute[75354]:   </features>
Nov 14 06:41:09 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:41:09 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:41:09 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:41:09 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:41:09 user nova-compute[75354]:   </clock>
Nov 14 06:41:09 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:41:09 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:41:09 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:41:09 user nova-compute[75354]:   </cpu>
Nov 14 06:41:09 user nova-compute[75354]:   <devices>
Nov 14 06:41:09 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:41:09 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:41:09 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk"/>
Nov 14 06:41:09 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:41:09 user nova-compute[75354]:     </disk>
Nov 14 06:41:09 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:41:09 user nova-compute[75354]:       <mac address="fa:16:3e:fa:09:47"/>
Nov 14 06:41:09 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:41:09 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:41:09 user nova-compute[75354]:       <target dev="tapfb6f1139-c1"/>
Nov 14 06:41:09 user nova-compute[75354]:     </interface>
Nov 14 06:41:09 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:41:09 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/console.log" append="off"/>
Nov 14 06:41:09 user nova-compute[75354]:     </serial>
Nov 14 06:41:09 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:41:09 user nova-compute[75354]:     <video>
Nov 14 06:41:09 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:41:09 user nova-compute[75354]:     </video>
Nov 14 06:41:09 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:41:09 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:41:09 user nova-compute[75354]:     </rng>
Nov 14 06:41:09 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:41:09 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:41:09 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:41:09 user nova-compute[75354]:     </memballoon>
Nov 14 06:41:09 user nova-compute[75354]:   </devices>
Nov 14 06:41:09 user nova-compute[75354]: </domain>
Nov 14 06:41:09 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1826004795',display_name='tempest-ServersNegativeTestJSON-server-1826004795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1826004795',id=26,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0829bb25ebb344eeb7cc2cfbb6990db0',ramdisk_id='',reservation_id='r-hcg8kfdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-906617313',owner_user_name='tempest-ServersNegativeTestJSON-906617313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:41:08Z,user_data=None,user_id='1d439693760147d2aab8152ac87480fa',uuid=d41a9954-e03a-42ce-bf0c-0ef7db1712c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converting VIF {"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG os_vif [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82a6f418-f24e-50f5-be89-68bffc224fae', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb6f1139-c1, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb6f1139-c1, col_values=(('qos', UUID('e86c69ca-7c46-4e7e-98d5-d95db9d2dfa3')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb6f1139-c1, col_values=(('external_ids', {'iface-id': 'fb6f1139-c130-4cd6-bd14-08d1c900353d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:09:47', 'vm-uuid': 'd41a9954-e03a-42ce-bf0c-0ef7db1712c6'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:09 user nova-compute[75354]: INFO os_vif [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1')
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] No VIF found with MAC fa:16:3e:fa:09:47, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.neutron [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Updated VIF entry in instance network info cache for port fb6f1139-c130-4cd6-bd14-08d1c900353d. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG nova.network.neutron [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Updating instance_info_cache with network_info: [{"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2a9f4432-358b-424a-b0ad-90179fff8f37 req-ba5c88a2-fa8e-4a6b-a414-41b014a53deb service nova] Releasing lock "refresh_cache-d41a9954-e03a-42ce-bf0c-0ef7db1712c6" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-ff3291ba-eb23-49af-afec-9ac0d10b68e4 req-c9968366-356e-4a14-bfbc-1585f669d2b6 service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ff3291ba-eb23-49af-afec-9ac0d10b68e4 req-c9968366-356e-4a14-bfbc-1585f669d2b6 service nova] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ff3291ba-eb23-49af-afec-9ac0d10b68e4 req-c9968366-356e-4a14-bfbc-1585f669d2b6 service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ff3291ba-eb23-49af-afec-9ac0d10b68e4 req-c9968366-356e-4a14-bfbc-1585f669d2b6 service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-ff3291ba-eb23-49af-afec-9ac0d10b68e4 req-c9968366-356e-4a14-bfbc-1585f669d2b6 service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] No waiting events found dispatching network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:10 user nova-compute[75354]: WARNING nova.compute.manager [req-ff3291ba-eb23-49af-afec-9ac0d10b68e4 req-c9968366-356e-4a14-bfbc-1585f669d2b6 service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received unexpected event network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d for instance with vm_state building and task_state spawning.
Nov 14 06:41:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43e8f13f-dbae-4b75-a14d-f563ba912701 is timed out.
Nov 14 06:41:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully detached device vdb from instance 43e8f13f-dbae-4b75-a14d-f563ba912701 from the live domain config.
Nov 14 06:41:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOERPmqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:41:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb9564-9937-4b4c-a7fe-f2f6653d8372]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:41:11 user nova-compute[75354]: No targets found.
Nov 14 06:41:11 user nova-compute[75354]: iSNS:
Nov 14 06:41:11 user nova-compute[75354]: No targets found.
Nov 14 06:41:11 user nova-compute[75354]: STATIC:
Nov 14 06:41:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:41:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c
Nov 14 06:41:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:41:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:11 user nova-compute[75354]: FIRMWARE:
Nov 14 06:41:11 user nova-compute[75354]: No targets found.
Nov 14 06:41:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:41:11 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:41:11 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cd3685-42d7-4f49-b385-fc44f89fa681]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e15b7-ddf2-4f97-b5d8-26d5fbd4c03f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:41:11 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:41:11 user nova-compute[75354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c (non-flash)
Nov 14 06:41:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:41:11 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:41:11 user nova-compute[75354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c (non-flash)
Nov 14 06:41:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809426c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e062549-27e8-4c45-8a10-34391be9ff3b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9ea05b-2681-4e8e-948a-ea6ba9ebd3ae]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee81ae-c603-4dd4-9206-ac7579703a3c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478f833-84e3-4154-931d-4ac3dc44d115]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9135d2-cb23-41dc-bca3-47d78b388484]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921d0e5-afe9-42a0-b0d7-94efcc8fca6e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260]
Nov 14 06:41:11 user nova-compute[75354]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c, portal: 172.16.0.220,3260] successful.
Nov 14 06:41:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b62bf8f-9025-45fe-a696-ed90d6d21701]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== disconnect_volume: return (301ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:41:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'flavor' on Instance uuid 43e8f13f-dbae-4b75-a14d-f563ba912701 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5fc43284-9634-41df-bc21-adfc758d5159 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.561s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:12 user nova-compute[75354]: INFO nova.compute.manager [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Terminating instance
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:41:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Instance spawned successfully.
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:12 user nova-compute[75354]: INFO nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 14 06:41:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Instance destroyed successfully.
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.objects.instance [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'resources' on Instance uuid 43e8f13f-dbae-4b75-a14d-f563ba912701 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1427091481',display_name='tempest-VolumesSnapshotTestJSON-instance-1427091481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1427091481',id=22,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6g/GraOImzeziG6lfw9Cg0gcpjAk535UfHdPHt2z22pbYFvr4rn3dgJuyMQ5qSdZ7TKaO/vM+djpgFo9E6qbhxIDG1h124BI4sJFBx1/aEhR3+FAxZovprA8Ey+voPOw==',key_name='tempest-keypair-1121458293',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:38:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='081861be85ab4c6eae414a2f8b98fde4',ramdisk_id='',reservation_id='r-ral6f0ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-518810154',owner_user_name='tempest-VolumesSnapshotTestJSON-518810154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1959e146b024fad873f92cf252aec6b',uuid=43e8f13f-dbae-4b75-a14d-f563ba912701,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converting VIF {"id": "5d061eec-f1c9-4dc0-942e-952053f85720", "address": "fa:16:3e:9f:71:99", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d061eec-f1", "ovs_interfaceid": "5d061eec-f1c9-4dc0-942e-952053f85720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_vif [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d061eec-f1, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86147786-6155-4ec8-ab1e-27bfb859fb6f) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:13 user nova-compute[75354]: INFO os_vif [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:71:99,bridge_name='br-int',has_traffic_filtering=True,id=5d061eec-f1c9-4dc0-942e-952053f85720,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d061eec-f1')
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOERPmqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:41:13 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.compute.manager [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Took 6.39 seconds to build instance.
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4dceba-dc3c-407f-96c8-a49b88643b24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:41:13 user nova-compute[75354]: No targets found.
Nov 14 06:41:13 user nova-compute[75354]: iSNS:
Nov 14 06:41:13 user nova-compute[75354]: No targets found.
Nov 14 06:41:13 user nova-compute[75354]: STATIC:
Nov 14 06:41:13 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:41:13 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:13 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:13 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:41:13 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:13 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:13 user nova-compute[75354]: FIRMWARE:
Nov 14 06:41:13 user nova-compute[75354]: No targets found.
Nov 14 06:41:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:41:13 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:41:13 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df977bdf-ab73-4032-baee-632c7402877c', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-769bfc54-644e-4ea9-a79f-58b63f86f6cf tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.482s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f91ecb1-5f56-43e5-ac1e-967e43e1f8cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc5d4f2-d9ea-452f-bffb-1f0e6f306a69]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:41:13 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:41:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:41:13 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:41:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743df640>, {}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Disconnecting from: [] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== disconnect_volume: return (76ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Deleting instance files /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701_del
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Deletion of /opt/stack/data/nova/instances/43e8f13f-dbae-4b75-a14d-f563ba912701_del complete
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] No waiting events found dispatching network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:13 user nova-compute[75354]: WARNING nova.compute.manager [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received unexpected event network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d for instance with vm_state active and task_state None.
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-vif-unplugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] No waiting events found dispatching network-vif-unplugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-072ee116-7476-4682-8125-4c7792896e8b req-da92389e-3de1-4c99-a420-0b0fd069335e service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-vif-unplugged-5d061eec-f1c9-4dc0-942e-952053f85720 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.compute.manager [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 06:41:13 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:13 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Took 0.72 seconds to deallocate network for instance.
Nov 14 06:41:13 user nova-compute[75354]: WARNING nova.volume.cinder [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Attachment 46173b13-c73e-408c-8a0b-66448bb8589f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 46173b13-c73e-408c-8a0b-66448bb8589f. (HTTP 404) (Request-ID: req-f507a82c-a9bf-4cb9-a638-a7d58ba1b430)
Nov 14 06:41:13 user nova-compute[75354]: INFO nova.compute.manager [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 06:41:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:14 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Deleted allocations for instance 43e8f13f-dbae-4b75-a14d-f563ba912701
Nov 14 06:41:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-5807bf8f-6807-41e5-883d-0e247e79dea1 tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:14 user nova-compute[75354]: INFO nova.compute.manager [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Detaching volume b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:41:14 user nova-compute[75354]: INFO nova.virt.block_device [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Attempting to driver detach volume b94f5e26-b428-4ec6-8c3d-9fd4337960d4 from mountpoint /dev/vdb
Nov 14 06:41:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Attempting to detach device vdb from instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:41:14 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:41:14 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:41:14 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:41:14 user nova-compute[75354]:   <serial>b94f5e26-b428-4ec6-8c3d-9fd4337960d4</serial>
Nov 14 06:41:14 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:41:14 user nova-compute[75354]: </disk>
Nov 14 06:41:14 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:41:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Successfully detached device vdb from instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 from the persistent domain config.
Nov 14 06:41:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:41:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:41:14 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:41:14 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:41:14 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:41:14 user nova-compute[75354]:   <serial>b94f5e26-b428-4ec6-8c3d-9fd4337960d4</serial>
Nov 14 06:41:14 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:41:14 user nova-compute[75354]: </disk>
Nov 14 06:41:14 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:41:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] Acquiring lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] Lock "43e8f13f-dbae-4b75-a14d-f563ba912701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] No waiting events found dispatching network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:15 user nova-compute[75354]: WARNING nova.compute.manager [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received unexpected event network-vif-plugged-5d061eec-f1c9-4dc0-942e-952053f85720 for instance with vm_state deleted and task_state None.
Nov 14 06:41:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-18333a2f-1067-4db5-acc0-f8866f4715fc req-ef07cf36-adbf-48f0-ab30-b4fb18a0682a service nova] [instance: 43e8f13f-dbae-4b75-a14d-f563ba912701] Received event network-vif-deleted-5d061eec-f1c9-4dc0-942e-952053f85720 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:41:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 is timed out.
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Successfully detached device vdb from instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 from the live domain config.
Nov 14 06:41:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohBUNzmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:41:35 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead938ff-366f-45ff-89c6-2d3dbb6dda1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:41:35 user nova-compute[75354]: No targets found.
Nov 14 06:41:35 user nova-compute[75354]: iSNS:
Nov 14 06:41:35 user nova-compute[75354]: No targets found.
Nov 14 06:41:35 user nova-compute[75354]: STATIC:
Nov 14 06:41:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4
Nov 14 06:41:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:35 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:41:35 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:41:35 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:41:35 user nova-compute[75354]: FIRMWARE:
Nov 14 06:41:35 user nova-compute[75354]: No targets found.
Nov 14 06:41:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:41:35 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:41:35 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0cfa83-c22b-4293-98cf-6c966705818a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37babc28-d56f-4649-bf60-231d84f9673c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:41:35 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:41:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:41:35 user nova-compute[75354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 (non-flash)
Nov 14 06:41:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074457370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[289a7edc-66cc-47ef-a479-c483b9d31255]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd967c2-c9a9-4433-afcf-301b01ca6f09]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f77c5-aa1d-422f-a212-d3ac945a3a50]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb1ffb1-94a2-4ff9-af59-e1045e87348b]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614661f-295f-4797-9b7d-3087b003de7d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b01d7e-79ba-435e-bc77-85e85097a355]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260]
Nov 14 06:41:35 user nova-compute[75354]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4, portal: 172.16.0.220,3260] successful.
Nov 14 06:41:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94f5e26-b428-4ec6-8c3d-9fd4337960d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba25998c-64a9-4830-9145-5bfff22396ed]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] <== disconnect_volume: return (359ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'flavor' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-acdbf353-51a6-481a-bbf9-730c57107abe tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:37 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:37 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7476MB free_disk=25.153003692626953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:41:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance f0794e7d-f909-456f-b9db-1aa833099848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d41a9954-e03a-42ce-bf0c-0ef7db1712c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:41:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.861s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:41:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:44 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [{"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-5c304a52-fe97-4cf5-88fc-cda18858cf50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:41:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:41:50 user nova-compute[75354]: INFO nova.compute.claims [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Claim successful on node user
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:41:50 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:41:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG nova.policy [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1959e146b024fad873f92cf252aec6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081861be85ab4c6eae414a2f8b98fde4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:41:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Creating image(s)
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "/opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "/opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk 1073741824" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:51 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Successfully created port: b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Cannot resize image /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Ensure instance console log exists: /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Successfully updated port: b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquired lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-changed-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Refreshing instance network info cache due to event network-changed-b217109c-5da7-4c36-a2e3-6949fb230bc3. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] Acquiring lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updating instance_info_cache with network_info: [{"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Releasing lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Instance network_info: |[{"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] Acquired lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Refreshing network info cache for port b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Start _get_guest_xml network_info=[{"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:41:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-203241767',display_name='tempest-VolumesSnapshotTestJSON-instance-203241767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-203241767',id=27,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZndrGmte7hoIsV9BkZQ0xuy8n7Kjjo6jX/7Le91WB6OITJzgvUg1I+JSHV+vBAeLeIoLnvlzp9RGqi0I1AI1/b8Rf6gV6rBKZI8nlBtzOC+YpIipPZCBvqqBCf9DzrAA==',key_name='tempest-keypair-1233857804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='081861be85ab4c6eae414a2f8b98fde4',ramdisk_id='',reservation_id='r-v63grsnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-518810154',owner_user_name='tempest-VolumesSnapshotTestJSON-518810154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1959e146b024fad873f92cf252aec6b',uuid=a7341396-5af8-4616-95d3-9cdb8c6e0a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converting VIF {"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'pci_devices' on Instance uuid a7341396-5af8-4616-95d3-9cdb8c6e0a72 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:41:52 user nova-compute[75354]:   <uuid>a7341396-5af8-4616-95d3-9cdb8c6e0a72</uuid>
Nov 14 06:41:52 user nova-compute[75354]:   <name>instance-0000001b</name>
Nov 14 06:41:52 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:41:52 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:41:52 user nova-compute[75354]:   <metadata>
Nov 14 06:41:52 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:41:52 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:41:52 user nova-compute[75354]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-203241767</nova:name>
Nov 14 06:41:52 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:41:52</nova:creationTime>
Nov 14 06:41:52 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:41:52 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:41:52 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:41:52 user nova-compute[75354]:       <nova:owner>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:user uuid="d1959e146b024fad873f92cf252aec6b">tempest-VolumesSnapshotTestJSON-518810154-project-member</nova:user>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:project uuid="081861be85ab4c6eae414a2f8b98fde4">tempest-VolumesSnapshotTestJSON-518810154</nova:project>
Nov 14 06:41:52 user nova-compute[75354]:       </nova:owner>
Nov 14 06:41:52 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:41:52 user nova-compute[75354]:       <nova:ports>
Nov 14 06:41:52 user nova-compute[75354]:         <nova:port uuid="b217109c-5da7-4c36-a2e3-6949fb230bc3">
Nov 14 06:41:52 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 06:41:52 user nova-compute[75354]:         </nova:port>
Nov 14 06:41:52 user nova-compute[75354]:       </nova:ports>
Nov 14 06:41:52 user nova-compute[75354]:     </nova:instance>
Nov 14 06:41:52 user nova-compute[75354]:   </metadata>
Nov 14 06:41:52 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:41:52 user nova-compute[75354]:     <system>
Nov 14 06:41:52 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:41:52 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:41:52 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:41:52 user nova-compute[75354]:       <entry name="serial">a7341396-5af8-4616-95d3-9cdb8c6e0a72</entry>
Nov 14 06:41:52 user nova-compute[75354]:       <entry name="uuid">a7341396-5af8-4616-95d3-9cdb8c6e0a72</entry>
Nov 14 06:41:52 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:41:52 user nova-compute[75354]:     </system>
Nov 14 06:41:52 user nova-compute[75354]:   </sysinfo>
Nov 14 06:41:52 user nova-compute[75354]:   <os>
Nov 14 06:41:52 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:41:52 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:41:52 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:41:52 user nova-compute[75354]:   </os>
Nov 14 06:41:52 user nova-compute[75354]:   <features>
Nov 14 06:41:52 user nova-compute[75354]:     <acpi/>
Nov 14 06:41:52 user nova-compute[75354]:     <apic/>
Nov 14 06:41:52 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:41:52 user nova-compute[75354]:   </features>
Nov 14 06:41:52 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:41:52 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:41:52 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:41:52 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:41:52 user nova-compute[75354]:   </clock>
Nov 14 06:41:52 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:41:52 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:41:52 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:41:52 user nova-compute[75354]:   </cpu>
Nov 14 06:41:52 user nova-compute[75354]:   <devices>
Nov 14 06:41:52 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:41:52 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:41:52 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk"/>
Nov 14 06:41:52 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:41:52 user nova-compute[75354]:     </disk>
Nov 14 06:41:52 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:41:52 user nova-compute[75354]:       <mac address="fa:16:3e:07:65:97"/>
Nov 14 06:41:52 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:41:52 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:41:52 user nova-compute[75354]:       <target dev="tapb217109c-5d"/>
Nov 14 06:41:52 user nova-compute[75354]:     </interface>
Nov 14 06:41:52 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:41:52 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/console.log" append="off"/>
Nov 14 06:41:52 user nova-compute[75354]:     </serial>
Nov 14 06:41:52 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:41:52 user nova-compute[75354]:     <video>
Nov 14 06:41:52 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:41:52 user nova-compute[75354]:     </video>
Nov 14 06:41:52 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:41:52 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:41:52 user nova-compute[75354]:     </rng>
Nov 14 06:41:52 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:41:52 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:41:52 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:41:52 user nova-compute[75354]:     </memballoon>
Nov 14 06:41:52 user nova-compute[75354]:   </devices>
Nov 14 06:41:52 user nova-compute[75354]: </domain>
Nov 14 06:41:52 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-203241767',display_name='tempest-VolumesSnapshotTestJSON-instance-203241767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-203241767',id=27,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZndrGmte7hoIsV9BkZQ0xuy8n7Kjjo6jX/7Le91WB6OITJzgvUg1I+JSHV+vBAeLeIoLnvlzp9RGqi0I1AI1/b8Rf6gV6rBKZI8nlBtzOC+YpIipPZCBvqqBCf9DzrAA==',key_name='tempest-keypair-1233857804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='081861be85ab4c6eae414a2f8b98fde4',ramdisk_id='',reservation_id='r-v63grsnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-518810154',owner_user_name='tempest-VolumesSnapshotTestJSON-518810154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1959e146b024fad873f92cf252aec6b',uuid=a7341396-5af8-4616-95d3-9cdb8c6e0a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converting VIF {"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG os_vif [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96db18cc-5c95-5992-95cb-b7282fffadd3', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb217109c-5d, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb217109c-5d, col_values=(('qos', UUID('c1edb02f-f213-4218-9dd5-21939465bcef')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb217109c-5d, col_values=(('external_ids', {'iface-id': 'b217109c-5da7-4c36-a2e3-6949fb230bc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:65:97', 'vm-uuid': 'a7341396-5af8-4616-95d3-9cdb8c6e0a72'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:53 user nova-compute[75354]: INFO os_vif [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d')
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No VIF found with MAC fa:16:3e:07:65:97, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:41:53 user nova-compute[75354]: INFO nova.compute.claims [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Claim successful on node user
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updated VIF entry in instance network info cache for port b217109c-5da7-4c36-a2e3-6949fb230bc3. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updating instance_info_cache with network_info: [{"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e69b5e62-61f9-4d18-a474-e1bfa468272c req-089914b0-e8e9-494b-9624-e9cd05e4b8a1 service nova] Releasing lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:41:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.policy [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70d7d1261dfa452cacd628da418f7783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ecd6fc1944b583d57d14e2a0559e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:41:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Creating image(s)
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk 1073741824" returned: 0 in 0.056s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Successfully created port: fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-fee51991-da1a-443e-996a-c93efa7c4c67 req-228b529e-bbdd-472a-a3e0-88ff76a13805 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fee51991-da1a-443e-996a-c93efa7c4c67 req-228b529e-bbdd-472a-a3e0-88ff76a13805 service nova] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fee51991-da1a-443e-996a-c93efa7c4c67 req-228b529e-bbdd-472a-a3e0-88ff76a13805 service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fee51991-da1a-443e-996a-c93efa7c4c67 req-228b529e-bbdd-472a-a3e0-88ff76a13805 service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-fee51991-da1a-443e-996a-c93efa7c4c67 req-228b529e-bbdd-472a-a3e0-88ff76a13805 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] No waiting events found dispatching network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:54 user nova-compute[75354]: WARNING nova.compute.manager [req-fee51991-da1a-443e-996a-c93efa7c4c67 req-228b529e-bbdd-472a-a3e0-88ff76a13805 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received unexpected event network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 for instance with vm_state building and task_state spawning.
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Cannot resize image /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Successfully updated port: fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing instance network info cache due to event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:41:55 user nova-compute[75354]: INFO nova.compute.manager [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Unrescuing
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance network_info: |[{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Start _get_guest_xml network_info=[{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:41:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904050191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904050191',id=28,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1A3A9BcukZawHUjUEds9uc2Hcqr3jc5IY1p1IsXGtKSxB2rzUy15LsDIcKRGb/seUMdkbYxF0qk5yDP2v6y27ASZXAnCQbMDyzSdmof3YH+PONl7tETrcpVZBF2t6G0g==',key_name='tempest-keypair-1737925936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-p90j785d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=a63ddb47-d6c2-48c2-9a43-a1a41583b3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'pci_devices' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:41:55 user nova-compute[75354]:   <uuid>a63ddb47-d6c2-48c2-9a43-a1a41583b3ca</uuid>
Nov 14 06:41:55 user nova-compute[75354]:   <name>instance-0000001c</name>
Nov 14 06:41:55 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:41:55 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:41:55 user nova-compute[75354]:   <metadata>
Nov 14 06:41:55 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:41:55 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:41:55 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-904050191</nova:name>
Nov 14 06:41:55 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:41:55</nova:creationTime>
Nov 14 06:41:55 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:41:55 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:41:55 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:41:55 user nova-compute[75354]:       <nova:owner>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:user uuid="70d7d1261dfa452cacd628da418f7783">tempest-AttachVolumeShelveTestJSON-443282580-project-member</nova:user>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:project uuid="00f5ecd6fc1944b583d57d14e2a0559e">tempest-AttachVolumeShelveTestJSON-443282580</nova:project>
Nov 14 06:41:55 user nova-compute[75354]:       </nova:owner>
Nov 14 06:41:55 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:41:55 user nova-compute[75354]:       <nova:ports>
Nov 14 06:41:55 user nova-compute[75354]:         <nova:port uuid="fa23886d-d71e-4a0c-8e95-631c6e6487c1">
Nov 14 06:41:55 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:41:55 user nova-compute[75354]:         </nova:port>
Nov 14 06:41:55 user nova-compute[75354]:       </nova:ports>
Nov 14 06:41:55 user nova-compute[75354]:     </nova:instance>
Nov 14 06:41:55 user nova-compute[75354]:   </metadata>
Nov 14 06:41:55 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:41:55 user nova-compute[75354]:     <system>
Nov 14 06:41:55 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:41:55 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:41:55 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:41:55 user nova-compute[75354]:       <entry name="serial">a63ddb47-d6c2-48c2-9a43-a1a41583b3ca</entry>
Nov 14 06:41:55 user nova-compute[75354]:       <entry name="uuid">a63ddb47-d6c2-48c2-9a43-a1a41583b3ca</entry>
Nov 14 06:41:55 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:41:55 user nova-compute[75354]:     </system>
Nov 14 06:41:55 user nova-compute[75354]:   </sysinfo>
Nov 14 06:41:55 user nova-compute[75354]:   <os>
Nov 14 06:41:55 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:41:55 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:41:55 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:41:55 user nova-compute[75354]:   </os>
Nov 14 06:41:55 user nova-compute[75354]:   <features>
Nov 14 06:41:55 user nova-compute[75354]:     <acpi/>
Nov 14 06:41:55 user nova-compute[75354]:     <apic/>
Nov 14 06:41:55 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:41:55 user nova-compute[75354]:   </features>
Nov 14 06:41:55 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:41:55 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:41:55 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:41:55 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:41:55 user nova-compute[75354]:   </clock>
Nov 14 06:41:55 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:41:55 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:41:55 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:41:55 user nova-compute[75354]:   </cpu>
Nov 14 06:41:55 user nova-compute[75354]:   <devices>
Nov 14 06:41:55 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:41:55 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:41:55 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk"/>
Nov 14 06:41:55 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:41:55 user nova-compute[75354]:     </disk>
Nov 14 06:41:55 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:41:55 user nova-compute[75354]:       <mac address="fa:16:3e:c9:fc:29"/>
Nov 14 06:41:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:41:55 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:41:55 user nova-compute[75354]:       <target dev="tapfa23886d-d7"/>
Nov 14 06:41:55 user nova-compute[75354]:     </interface>
Nov 14 06:41:55 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:41:55 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/console.log" append="off"/>
Nov 14 06:41:55 user nova-compute[75354]:     </serial>
Nov 14 06:41:55 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:41:55 user nova-compute[75354]:     <video>
Nov 14 06:41:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:41:55 user nova-compute[75354]:     </video>
Nov 14 06:41:55 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:41:55 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:41:55 user nova-compute[75354]:     </rng>
Nov 14 06:41:55 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:41:55 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:41:55 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:41:55 user nova-compute[75354]:     </memballoon>
Nov 14 06:41:55 user nova-compute[75354]:   </devices>
Nov 14 06:41:55 user nova-compute[75354]: </domain>
Nov 14 06:41:55 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904050191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904050191',id=28,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1A3A9BcukZawHUjUEds9uc2Hcqr3jc5IY1p1IsXGtKSxB2rzUy15LsDIcKRGb/seUMdkbYxF0qk5yDP2v6y27ASZXAnCQbMDyzSdmof3YH+PONl7tETrcpVZBF2t6G0g==',key_name='tempest-keypair-1737925936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-p90j785d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=a63ddb47-d6c2-48c2-9a43-a1a41583b3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG os_vif [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97ccbce7-0a25-53a1-8df9-0339eee83944', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa23886d-d7, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa23886d-d7, col_values=(('qos', UUID('f9f329b3-c4fa-4101-ba72-f43b85aa43dd')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa23886d-d7, col_values=(('external_ids', {'iface-id': 'fa23886d-d71e-4a0c-8e95-631c6e6487c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:fc:29', 'vm-uuid': 'a63ddb47-d6c2-48c2-9a43-a1a41583b3ca'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: INFO os_vif [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7')
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No VIF found with MAC fa:16:3e:c9:fc:29, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'flavor' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updated VIF entry in instance network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8105cc65-718f-43b9-9625-9fb99e70e7e4 req-1355a0b7-39a1-4ec5-806d-49d1b328ddb9 service nova] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:41:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance destroyed successfully.
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:41:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Instance spawned successfully.
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-c91c0592-f922-4b7b-838a-78389af09052 req-ae1d8b0f-a9eb-4ddf-84bc-2c18a1fb829d service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c91c0592-f922-4b7b-838a-78389af09052 req-ae1d8b0f-a9eb-4ddf-84bc-2c18a1fb829d service nova] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c91c0592-f922-4b7b-838a-78389af09052 req-ae1d8b0f-a9eb-4ddf-84bc-2c18a1fb829d service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c91c0592-f922-4b7b-838a-78389af09052 req-ae1d8b0f-a9eb-4ddf-84bc-2c18a1fb829d service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-c91c0592-f922-4b7b-838a-78389af09052 req-ae1d8b0f-a9eb-4ddf-84bc-2c18a1fb829d service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] No waiting events found dispatching network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:56 user nova-compute[75354]: WARNING nova.compute.manager [req-c91c0592-f922-4b7b-838a-78389af09052 req-ae1d8b0f-a9eb-4ddf-84bc-2c18a1fb829d service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received unexpected event network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 for instance with vm_state building and task_state spawning.
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: INFO nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 14 06:41:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:41:56 user nova-compute[75354]: INFO nova.compute.manager [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Took 6.40 seconds to build instance.
Nov 14 06:41:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1db383d5-da66-4f35-b0ee-bbf0dca140bd tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:57 user nova-compute[75354]: WARNING nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:57 user nova-compute[75354]: WARNING nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:57 user nova-compute[75354]: WARNING nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:57 user nova-compute[75354]: WARNING nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:57 user nova-compute[75354]: WARNING nova.compute.manager [req-26d04e14-3c6c-4f59-a1b8-43bb816066a6 req-b718f94a-1a06-4029-bc5f-f435a210dda4 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:41:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:59 user nova-compute[75354]: WARNING nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:59 user nova-compute[75354]: WARNING nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state building and task_state spawning.
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:59 user nova-compute[75354]: WARNING nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state building and task_state spawning.
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:41:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:41:59 user nova-compute[75354]: WARNING nova.compute.manager [req-ba84a2cb-ea5a-40c5-a0e1-39751cd350ff req-d033f429-e2dc-43b0-a0b8-fee32b8d0211 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:42:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:42:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance spawned successfully.
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd01ea1e-0aa7-4130-ad50-3873125b3cf4 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:42:01 user nova-compute[75354]: INFO nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 14 06:42:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:42:01 user nova-compute[75354]: INFO nova.compute.manager [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Took 8.03 seconds to build instance.
Nov 14 06:42:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-36fd89ec-87c9-4c19-8736-d635443bf094 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.131s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-76fde585-6396-456d-8ff5-44103e3757fa req-66f4f218-34ef-403b-8e1c-908eef4e3706 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-76fde585-6396-456d-8ff5-44103e3757fa req-66f4f218-34ef-403b-8e1c-908eef4e3706 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-76fde585-6396-456d-8ff5-44103e3757fa req-66f4f218-34ef-403b-8e1c-908eef4e3706 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-76fde585-6396-456d-8ff5-44103e3757fa req-66f4f218-34ef-403b-8e1c-908eef4e3706 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-76fde585-6396-456d-8ff5-44103e3757fa req-66f4f218-34ef-403b-8e1c-908eef4e3706 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:01 user nova-compute[75354]: WARNING nova.compute.manager [req-76fde585-6396-456d-8ff5-44103e3757fa req-66f4f218-34ef-403b-8e1c-908eef4e3706 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state active and task_state None.
Nov 14 06:42:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:05 user nova-compute[75354]: INFO nova.compute.manager [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Terminating instance
Nov 14 06:42:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-93b08077-5302-49b4-8302-88acf189a831 req-6af33e2e-f544-473a-a078-32b920c9e463 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-93b08077-5302-49b4-8302-88acf189a831 req-6af33e2e-f544-473a-a078-32b920c9e463 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-93b08077-5302-49b4-8302-88acf189a831 req-6af33e2e-f544-473a-a078-32b920c9e463 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-93b08077-5302-49b4-8302-88acf189a831 req-6af33e2e-f544-473a-a078-32b920c9e463 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-93b08077-5302-49b4-8302-88acf189a831 req-6af33e2e-f544-473a-a078-32b920c9e463 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-93b08077-5302-49b4-8302-88acf189a831 req-6af33e2e-f544-473a-a078-32b920c9e463 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Instance destroyed successfully.
Nov 14 06:42:06 user nova-compute[75354]: DEBUG nova.objects.instance [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lazy-loading 'resources' on Instance uuid 5c304a52-fe97-4cf5-88fc-cda18858cf50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-345416593',display_name='tempest-ServerStableDeviceRescueTest-server-345416593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-345416593',id=19,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZR5pP6FsBgkL8Zrc4FgO5hbq2x8EryNGCtSLww6ZvFPZMwxvSVBkedxHUJHZOdxGyzz6rqx3IaItfVR0WBep5naWgrGI0ci+APiVyPKKNlIoNQczcjWiyoCHKtsvFmmA==',key_name='tempest-keypair-505318022',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c10d2458fb34f8fb75bf2d227b047b8',ramdisk_id='',reservation_id='r-je2ls6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1966013656',owner_user_name='tempest-ServerStableDeviceRescueTest-1966013656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db86d1a052c40678cb7e4efe76a6dd9',uuid=5c304a52-fe97-4cf5-88fc-cda18858cf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converting VIF {"id": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "address": "fa:16:3e:ac:7f:c4", "network": {"id": "60ecd09e-01e9-425e-8fa7-42da85bce053", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1748589038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c10d2458fb34f8fb75bf2d227b047b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea2ee8-43", "ovs_interfaceid": "b8ea2ee8-43e9-42bc-96d1-aa78c39beca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG os_vif [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8ea2ee8-43, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8efac2d5-9602-4d4c-9717-77ca5a8b69d4) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:06 user nova-compute[75354]: INFO os_vif [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7f:c4,bridge_name='br-int',has_traffic_filtering=True,id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1,network=Network(60ecd09e-01e9-425e-8fa7-42da85bce053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea2ee8-43')
Nov 14 06:42:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Deleting instance files /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50_del
Nov 14 06:42:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Deletion of /opt/stack/data/nova/instances/5c304a52-fe97-4cf5-88fc-cda18858cf50_del complete
Nov 14 06:42:06 user nova-compute[75354]: INFO nova.compute.manager [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 06:42:06 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-87bf2e95-2928-4e46-9422-1740ba8e7240 req-5f0246ae-9348-499f-b58a-0b206e2bc844 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-deleted-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:07 user nova-compute[75354]: INFO nova.compute.manager [req-87bf2e95-2928-4e46-9422-1740ba8e7240 req-5f0246ae-9348-499f-b58a-0b206e2bc844 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Neutron deleted interface b8ea2ee8-43e9-42bc-96d1-aa78c39beca1; detaching it from the instance and deleting it from the info cache
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.network.neutron [req-87bf2e95-2928-4e46-9422-1740ba8e7240 req-5f0246ae-9348-499f-b58a-0b206e2bc844 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:07 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Took 0.83 seconds to deallocate network for instance.
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-87bf2e95-2928-4e46-9422-1740ba8e7240 req-5f0246ae-9348-499f-b58a-0b206e2bc844 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Detach interface failed, port_id=b8ea2ee8-43e9-42bc-96d1-aa78c39beca1, reason: Instance 5c304a52-fe97-4cf5-88fc-cda18858cf50 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:07 user nova-compute[75354]: WARNING nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state deleted and task_state None.
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:07 user nova-compute[75354]: WARNING nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state deleted and task_state None.
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:07 user nova-compute[75354]: WARNING nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state deleted and task_state None.
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:07 user nova-compute[75354]: WARNING nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-unplugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state deleted and task_state None.
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Acquiring lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] No waiting events found dispatching network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:07 user nova-compute[75354]: WARNING nova.compute.manager [req-8a4449ea-a005-4d33-82eb-f76a088dae8e req-2982816d-ffc7-4e5d-903a-5b46e1e33850 service nova] [instance: 5c304a52-fe97-4cf5-88fc-cda18858cf50] Received unexpected event network-vif-plugged-b8ea2ee8-43e9-42bc-96d1-aa78c39beca1 for instance with vm_state deleted and task_state None.
Nov 14 06:42:07 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:07 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Deleted allocations for instance 5c304a52-fe97-4cf5-88fc-cda18858cf50
Nov 14 06:42:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-29def3cc-6df3-458f-8e8c-f9d6747d383a tempest-ServerStableDeviceRescueTest-1966013656 tempest-ServerStableDeviceRescueTest-1966013656-project-member] Lock "5c304a52-fe97-4cf5-88fc-cda18858cf50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.454s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:42:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:10 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:42:10 user nova-compute[75354]: INFO nova.compute.claims [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Claim successful on node user
Nov 14 06:42:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:42:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.policy [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f141a1ef1b44b34b09a8f2f88d5af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601a7175bd194f79b4ae31d34f724de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:42:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Creating image(s)
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk 1073741824" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Successfully created port: 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Cannot resize image /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Ensure instance console log exists: /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Successfully updated port: 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing instance network info cache due to event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:42:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance network_info: |[{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Start _get_guest_xml network_info=[{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:42:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:42:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83301515',display_name='tempest-ServerRescueNegativeTestJSON-server-83301515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83301515',id=29,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa2ds0jIml6nHt0nv3LhtVzVQ3D8kB2BL2c4R8ovmhPqGlvlgZQDtSKINF1zixKNX2QobsqBJzwO93FVaY9Kx+iE/W27SV50I3QqNpqSwmz0IuH8rgatDP4wwv3EFMLNQ==',key_name='tempest-keypair-49713527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-22b8wu0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=852ddc06-5bfb-42d9-bfb4-74fc93ab3a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.objects.instance [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'pci_devices' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:42:13 user nova-compute[75354]:   <uuid>852ddc06-5bfb-42d9-bfb4-74fc93ab3a58</uuid>
Nov 14 06:42:13 user nova-compute[75354]:   <name>instance-0000001d</name>
Nov 14 06:42:13 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:42:13 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:42:13 user nova-compute[75354]:   <metadata>
Nov 14 06:42:13 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:42:13 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:42:13 user nova-compute[75354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-83301515</nova:name>
Nov 14 06:42:13 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:42:13</nova:creationTime>
Nov 14 06:42:13 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:42:13 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:42:13 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:42:13 user nova-compute[75354]:       <nova:owner>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:user uuid="7f141a1ef1b44b34b09a8f2f88d5af17">tempest-ServerRescueNegativeTestJSON-2059994566-project-member</nova:user>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:project uuid="601a7175bd194f79b4ae31d34f724de4">tempest-ServerRescueNegativeTestJSON-2059994566</nova:project>
Nov 14 06:42:13 user nova-compute[75354]:       </nova:owner>
Nov 14 06:42:13 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:42:13 user nova-compute[75354]:       <nova:ports>
Nov 14 06:42:13 user nova-compute[75354]:         <nova:port uuid="4dfd73ae-d00c-48d3-bd36-d25bbdf8b336">
Nov 14 06:42:13 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 06:42:13 user nova-compute[75354]:         </nova:port>
Nov 14 06:42:13 user nova-compute[75354]:       </nova:ports>
Nov 14 06:42:13 user nova-compute[75354]:     </nova:instance>
Nov 14 06:42:13 user nova-compute[75354]:   </metadata>
Nov 14 06:42:13 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:42:13 user nova-compute[75354]:     <system>
Nov 14 06:42:13 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:42:13 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:42:13 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:42:13 user nova-compute[75354]:       <entry name="serial">852ddc06-5bfb-42d9-bfb4-74fc93ab3a58</entry>
Nov 14 06:42:13 user nova-compute[75354]:       <entry name="uuid">852ddc06-5bfb-42d9-bfb4-74fc93ab3a58</entry>
Nov 14 06:42:13 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:42:13 user nova-compute[75354]:     </system>
Nov 14 06:42:13 user nova-compute[75354]:   </sysinfo>
Nov 14 06:42:13 user nova-compute[75354]:   <os>
Nov 14 06:42:13 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:42:13 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:42:13 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:42:13 user nova-compute[75354]:   </os>
Nov 14 06:42:13 user nova-compute[75354]:   <features>
Nov 14 06:42:13 user nova-compute[75354]:     <acpi/>
Nov 14 06:42:13 user nova-compute[75354]:     <apic/>
Nov 14 06:42:13 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:42:13 user nova-compute[75354]:   </features>
Nov 14 06:42:13 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:42:13 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:42:13 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:42:13 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:42:13 user nova-compute[75354]:   </clock>
Nov 14 06:42:13 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:42:13 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:42:13 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:42:13 user nova-compute[75354]:   </cpu>
Nov 14 06:42:13 user nova-compute[75354]:   <devices>
Nov 14 06:42:13 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:42:13 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:42:13 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk"/>
Nov 14 06:42:13 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:42:13 user nova-compute[75354]:     </disk>
Nov 14 06:42:13 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:42:13 user nova-compute[75354]:       <mac address="fa:16:3e:24:20:23"/>
Nov 14 06:42:13 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:42:13 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:42:13 user nova-compute[75354]:       <target dev="tap4dfd73ae-d0"/>
Nov 14 06:42:13 user nova-compute[75354]:     </interface>
Nov 14 06:42:13 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:42:13 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/console.log" append="off"/>
Nov 14 06:42:13 user nova-compute[75354]:     </serial>
Nov 14 06:42:13 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:42:13 user nova-compute[75354]:     <video>
Nov 14 06:42:13 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:42:13 user nova-compute[75354]:     </video>
Nov 14 06:42:13 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:42:13 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:42:13 user nova-compute[75354]:     </rng>
Nov 14 06:42:13 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:42:13 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:42:13 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:42:13 user nova-compute[75354]:     </memballoon>
Nov 14 06:42:13 user nova-compute[75354]:   </devices>
Nov 14 06:42:13 user nova-compute[75354]: </domain>
Nov 14 06:42:13 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83301515',display_name='tempest-ServerRescueNegativeTestJSON-server-83301515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83301515',id=29,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa2ds0jIml6nHt0nv3LhtVzVQ3D8kB2BL2c4R8ovmhPqGlvlgZQDtSKINF1zixKNX2QobsqBJzwO93FVaY9Kx+iE/W27SV50I3QqNpqSwmz0IuH8rgatDP4wwv3EFMLNQ==',key_name='tempest-keypair-49713527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-22b8wu0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=852ddc06-5bfb-42d9-bfb4-74fc93ab3a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG os_vif [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '796d5869-b636-5aaf-9a3d-59b1e208da44', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dfd73ae-d0, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dfd73ae-d0, col_values=(('qos', UUID('3ceff866-e3af-48b4-954b-0b1f52064b64')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dfd73ae-d0, col_values=(('external_ids', {'iface-id': '4dfd73ae-d00c-48d3-bd36-d25bbdf8b336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:20:23', 'vm-uuid': '852ddc06-5bfb-42d9-bfb4-74fc93ab3a58'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:13 user nova-compute[75354]: INFO os_vif [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0')
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-changed-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Refreshing instance network info cache due to event network-changed-42699268-e3da-4ff4-b5f0-8e86e29b1162. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] Acquiring lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] Acquired lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Refreshing network info cache for port 42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:24:20:23, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updated VIF entry in instance network info cache for port 42699268-e3da-4ff4-b5f0-8e86e29b1162. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updating instance_info_cache with network_info: [{"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-97370ddd-0c55-4c72-9b71-1ae097661d47 req-1a530fab-253f-4183-b65c-fb358115cc72 service nova] Releasing lock "refresh_cache-f0794e7d-f909-456f-b9db-1aa833099848" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updated VIF entry in instance network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d7c544f9-42e6-4472-a44e-f60a0567dde7 req-ef73a487-bfcb-4915-9e8a-e398e62245c2 service nova] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:42:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:15 user nova-compute[75354]: INFO nova.compute.manager [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attaching volume f6a2041b-6f8d-46bb-81eb-b4141328ac5b to /dev/vdb
Nov 14 06:42:15 user nova-compute[75354]: DEBUG os_brick.utils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b44c8-0e0e-4b27-b2d9-99d7aa3f7071]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b69dcf-fb9a-4bda-936d-c69656dc5bca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d360e9-b9c8-43a4-abb4-d6f54c8b76ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc2c3b-53d8-4393-93eb-fef624549e69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:15 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[176b84ca-ae7d-4ef0-a7de-d29c8f50a5e7]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG os_brick.utils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updating existing volume attachment record: 65b5c6c1-dfc3-4ee8-8d82-8472088b7f6e {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:15 user nova-compute[75354]: WARNING nova.compute.manager [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state building and task_state spawning.
Nov 14 06:42:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:15 user nova-compute[75354]: WARNING nova.compute.manager [req-818d0ee6-203a-44c9-9508-d9b5a020e45e req-2538adab-bc71-4c31-9cb4-908d0a281cde service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state building and task_state spawning.
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:42:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance spawned successfully.
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:16 user nova-compute[75354]: INFO nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 14 06:42:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:42:16 user nova-compute[75354]: INFO nova.compute.manager [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Took 6.03 seconds to build instance.
Nov 14 06:42:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-819b2161-33f5-4da4-91c3-9dfcbae6ffcb tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.123s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQpzdRJL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:19 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:19 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:19 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76016465-6059-414c-b91c-e9ad612367d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:42:19 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2deaa-075f-4610-b27e-1632a0723ac7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b] added
Nov 14 06:42:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64d412-d13d-43bc-8bc8-b22cf4787813]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a306aec6-0602-478e-9f73-702097f459b3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQpzdRJL {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQpzdRJL" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b65d14-4bd1-490c-9290-af24519c86b9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQpzdRJL'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb624dc-47df-48fd-81ec-ba71722b6a2e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc7381-39f9-4aaa-9a95-3734ef8ab679]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeb9b63-18ed-4620-a21f-29375280c6af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260]
Nov 14 06:42:19 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260] successful.
Nov 14 06:42:19 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd4611-20cd-4e9d-83bf-92142166acb9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f3ef3-8da5-4413-9239-e3f71e8fd730]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:20 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:20 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdbb3e3-afad-452e-b454-6fb648b197ca]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQpzdRJL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23038383063643361', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038383063643361', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:42:21 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:21 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:42:21 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:42:21 user nova-compute[75354]:   <serial>f6a2041b-6f8d-46bb-81eb-b4141328ac5b</serial>
Nov 14 06:42:21 user nova-compute[75354]: </disk>
Nov 14 06:42:21 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No VIF found with MAC fa:16:3e:9e:bd:c6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:42:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a9ed13b3-0489-46b2-b03a-0603cbb27214 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.366s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-changed-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Refreshing instance network info cache due to event network-changed-b86aea79-d2dd-4944-8e2e-23b4a28fead6. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] Acquiring lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] Acquired lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG nova.network.neutron [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Refreshing network info cache for port b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG nova.network.neutron [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updated VIF entry in instance network info cache for port b86aea79-d2dd-4944-8e2e-23b4a28fead6. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG nova.network.neutron [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating instance_info_cache with network_info: [{"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2750b3f7-4828-461e-a72e-c7f5e59fdcc2 req-709d9e35-5327-470b-aa1f-f20652edce22 service nova] Releasing lock "refresh_cache-240cd94c-cfe6-47a0-a57e-90fd1266c7b5" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'flavor' on Instance uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:23 user nova-compute[75354]: INFO nova.compute.manager [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attaching volume 3b473b12-917d-4dcb-af0f-43252ffb2607 to /dev/vdb
Nov 14 06:42:23 user nova-compute[75354]: DEBUG os_brick.utils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66bd9ee-9b04-419b-ad48-26a09cbd3a7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f526321-60df-48fb-abda-7af031dbae90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b4fe6f-db86-420f-9f08-6551736a5d72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb45f6-9ab3-4031-b02a-f5e2ed12c331]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:23 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b4c04-8091-4295-ac69-6cfa53dab925]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG os_brick.utils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating existing volume attachment record: eb44dc69-79d3-422d-aa8f-0f663a892996 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG nova.objects.instance [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:24 user nova-compute[75354]: INFO nova.compute.manager [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attaching volume bb9ce641-3f25-4517-99c7-e626a126b113 to /dev/vdc
Nov 14 06:42:24 user nova-compute[75354]: DEBUG os_brick.utils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19762a5e-32c9-4aea-8501-ef463c512f9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[175bcc6f-a5a0-43f1-9e7d-0c1e1937cfea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20abb708-f005-4d5d-bea0-68503b0d596a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f6386-dee0-4cd0-b70d-b0c8bee55bdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:24 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:42:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ff9a6-f276-4891-8af7-067413798ead]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG os_brick.utils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:24 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updating existing volume attachment record: df070ba4-38e3-498e-9445-1e9965a3ec5f {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:27 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:27 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:27 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d4429e-9432-434e-bba5-7ddd909c07a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:42:27 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcf1db0-28e8-4722-b6f4-d3207e6da37d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607] added
Nov 14 06:42:27 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e17b36a-3b3b-426f-be81-14e2a8afc290]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d4a8e-3b68-417f-a82e-536c63e582cb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziLthgbd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziLthgbd" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eac8d0-b51b-4bf1-8269-6ddedb044860]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ziLthgbd'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3680928-5f93-40d9-9def-26aecc6cc304]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ccf84a-01e2-49ef-8ad5-411a055678c4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:28 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:28 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c1cc9-4d9c-4fc4-9edd-458ccf58386f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]
Nov 14 06:42:28 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.
Nov 14 06:42:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657793a-484f-4e04-9d04-cb1ac85e5b2f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916ae7f-9d4f-4ce0-873c-326c11de8def]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:28 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:28 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:28 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:28 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8da5ba-3f66-4575-9278-aa4529e77d6a]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvfHZKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26634633437333163', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633437333163', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.697s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:29 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:29 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'flavor' on Instance uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b1e67-bf92-402f-a330-076993c0b7bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:42:29 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:42:29 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:29 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:42:29 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:42:29 user nova-compute[75354]:   <serial>3b473b12-917d-4dcb-af0f-43252ffb2607</serial>
Nov 14 06:42:29 user nova-compute[75354]: </disk>
Nov 14 06:42:29 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e8f902-568e-4d57-93c3-bf94a7b4583d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113] added
Nov 14 06:42:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f13f3-1e3e-4742-9519-920d7b9bbed7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd32e9-6bdd-4671-a9e1-6e21e17fe809]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLvfHZKU {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLvfHZKU" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9301c3-8837-4cbc-aeb8-2348e4b3ca84]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLvfHZKU'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae057fcc-6496-4f38-b05d-310b6425c103]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd659ff0-751f-4fa4-81eb-7a64ed10385e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cfca12-ce93-416c-956a-f8535e360949]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260]
Nov 14 06:42:29 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260] successful.
Nov 14 06:42:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a17190-a37c-4f55-b3da-fd1782b9da25]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff7b43-4615-4422-af89-25ba381de3c2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[324f9224-c5fb-4b40-950c-435e9d1b3255]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No VIF found with MAC fa:16:3e:b4:90:8b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:42:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b29bd125-0d61-486e-a61e-33cdc226aed0 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.855s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvfHZKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== connect_volume: return (2015ms) {'type': 'block', 'scsi_wwn': '23232356138653935', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232356138653935', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG nova.objects.instance [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:42:30 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:30 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:42:30 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:42:30 user nova-compute[75354]:   <serial>bb9ce641-3f25-4517-99c7-e626a126b113</serial>
Nov 14 06:42:30 user nova-compute[75354]: </disk>
Nov 14 06:42:30 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] No VIF found with MAC fa:16:3e:9e:bd:c6, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0adeb001-67d6-4634-8428-a9e7bdc2a861 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.269s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:31 user nova-compute[75354]: INFO nova.compute.manager [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Rebuilding instance
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-5529899e-61ff-4615-bb6d-1b79adb4be06 req-fae2a45f-d1eb-441a-a502-6f90c9919685 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-unplugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5529899e-61ff-4615-bb6d-1b79adb4be06 req-fae2a45f-d1eb-441a-a502-6f90c9919685 service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5529899e-61ff-4615-bb6d-1b79adb4be06 req-fae2a45f-d1eb-441a-a502-6f90c9919685 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5529899e-61ff-4615-bb6d-1b79adb4be06 req-fae2a45f-d1eb-441a-a502-6f90c9919685 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-5529899e-61ff-4615-bb6d-1b79adb4be06 req-fae2a45f-d1eb-441a-a502-6f90c9919685 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-unplugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:31 user nova-compute[75354]: WARNING nova.compute.manager [req-5529899e-61ff-4615-bb6d-1b79adb4be06 req-fae2a45f-d1eb-441a-a502-6f90c9919685 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-unplugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state active and task_state rebuilding.
Nov 14 06:42:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.compute.manager [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Detaching volume f6a2041b-6f8d-46bb-81eb-b4141328ac5b
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.virt.block_device [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attempting to driver detach volume f6a2041b-6f8d-46bb-81eb-b4141328ac5b from mountpoint /dev/vdb
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Attempting to detach device vdb from instance f0794e7d-f909-456f-b9db-1aa833099848 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:42:32 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:32 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:42:32 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:42:32 user nova-compute[75354]:   <serial>f6a2041b-6f8d-46bb-81eb-b4141328ac5b</serial>
Nov 14 06:42:32 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:42:32 user nova-compute[75354]: </disk>
Nov 14 06:42:32 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully detached device vdb from instance f0794e7d-f909-456f-b9db-1aa833099848 from the persistent domain config.
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0794e7d-f909-456f-b9db-1aa833099848 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:42:32 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:32 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:42:32 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:42:32 user nova-compute[75354]:   <serial>f6a2041b-6f8d-46bb-81eb-b4141328ac5b</serial>
Nov 14 06:42:32 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:42:32 user nova-compute[75354]: </disk>
Nov 14 06:42:32 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance destroyed successfully.
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.compute.manager [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Detaching volume 3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.virt.block_device [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attempting to driver detach volume 3b473b12-917d-4dcb-af0f-43252ffb2607 from mountpoint /dev/vdb
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Attempting to detach device vdb from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:42:32 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:32 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:42:32 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:42:32 user nova-compute[75354]:   <serial>3b473b12-917d-4dcb-af0f-43252ffb2607</serial>
Nov 14 06:42:32 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:42:32 user nova-compute[75354]: </disk>
Nov 14 06:42:32 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:42:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully detached device vdb from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 from the persistent domain config.
Nov 14 06:42:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:42:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba79659-71be-4bf5-b412-e50c89085196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:42:32 user nova-compute[75354]: No targets found.
Nov 14 06:42:32 user nova-compute[75354]: iSNS:
Nov 14 06:42:32 user nova-compute[75354]: No targets found.
Nov 14 06:42:32 user nova-compute[75354]: STATIC:
Nov 14 06:42:32 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113
Nov 14 06:42:32 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:32 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:32 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:42:32 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:32 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:32 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:42:32 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:32 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:32 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b
Nov 14 06:42:32 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:32 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:32 user nova-compute[75354]: FIRMWARE:
Nov 14 06:42:32 user nova-compute[75354]: No targets found.
Nov 14 06:42:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:42:32 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:42:32 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:42:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666f55a-1492-4ce8-96f9-df70df7f0d7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[299dbe00-0cdb-4b47-8507-14c9773d9cb0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:33 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:33 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:33 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:33 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:33 user nova-compute[75354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:33 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809434ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f6dea4-9c9a-41fd-9c66-b0efb608ead3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c4c811-8f78-4edf-94f4-a0cbb7426be9]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b03cfe-883b-42be-b577-c860f742ce1e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fbde56-22a2-4f24-b6f2-f1f15afbc86d]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e2bd5-f027-465e-b741-c7fb0be616f8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abde758-d3d1-46e8-97cf-aaab0d5c3620]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]
Nov 14 06:42:33 user nova-compute[75354]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.
Nov 14 06:42:33 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b3668-99c1-4097-b1f0-4b8df3e5c0aa]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== disconnect_volume: return (312ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-c17a503d-5c22-48f6-a72d-8b20ff86fb05 req-103d4994-4fe7-427c-8a4b-45f78c095116 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c17a503d-5c22-48f6-a72d-8b20ff86fb05 req-103d4994-4fe7-427c-8a4b-45f78c095116 service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c17a503d-5c22-48f6-a72d-8b20ff86fb05 req-103d4994-4fe7-427c-8a4b-45f78c095116 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c17a503d-5c22-48f6-a72d-8b20ff86fb05 req-103d4994-4fe7-427c-8a4b-45f78c095116 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-c17a503d-5c22-48f6-a72d-8b20ff86fb05 req-103d4994-4fe7-427c-8a4b-45f78c095116 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:33 user nova-compute[75354]: WARNING nova.compute.manager [req-c17a503d-5c22-48f6-a72d-8b20ff86fb05 req-103d4994-4fe7-427c-8a4b-45f78c095116 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state active and task_state rebuilding.
Nov 14 06:42:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance destroyed successfully.
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1145897967',display_name='tempest-ServerActionsTestOtherA-server-972822708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1145897967',id=25,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPbmueRvQCp8NqHkCrl+yrPwaxMxP5J2NT2Vaf31oFT1IvlI4SpRwbDbYwalpjGLQ42o8e/fTVcgQdeljAR+QqIS0S6/rg56+UP5l+gTokPzLjG1IO6wP/2PyM7b0XJmw==',key_name='tempest-keypair-1203834143',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-cerjhtt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=240cd94c-cfe6-47a0-a57e-90fd1266c7b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb86aea79-d2, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3c8f78f-935b-4dbf-9de5-e45db74f98cb) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:34 user nova-compute[75354]: INFO os_vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2')
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:34 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f27667-f26d-4aaf-839d-60ee857c4507]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:42:34 user nova-compute[75354]: No targets found.
Nov 14 06:42:34 user nova-compute[75354]: iSNS:
Nov 14 06:42:34 user nova-compute[75354]: No targets found.
Nov 14 06:42:34 user nova-compute[75354]: STATIC:
Nov 14 06:42:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113
Nov 14 06:42:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:42:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b
Nov 14 06:42:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:34 user nova-compute[75354]: FIRMWARE:
Nov 14 06:42:34 user nova-compute[75354]: No targets found.
Nov 14 06:42:34 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:42:34 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:42:34 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3283eb6-dde3-4d75-9f46-cbec76a7499e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4a89c-aa5f-4141-8c2c-c4bf295e42bb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:34 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:34 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:34 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:34 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:34 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:34 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809457eef0>, {}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Disconnecting from: [] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== disconnect_volume: return (69ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:42:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Deleting instance files /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5_del
Nov 14 06:42:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Deletion of /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5_del complete
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:42:34 user nova-compute[75354]: INFO nova.virt.block_device [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Booting with volume 3b473b12-917d-4dcb-af0f-43252ffb2607 at /dev/vdb
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.utils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9879e6-fb3f-4a50-8e12-bb0dca15180b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc991e1-c45e-4f8c-a0e8-7ed15147c43b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2d5ef-2c9d-48da-a709-3e3ffdb1af4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a9926-7b2f-4a66-9255-30a3add02a23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:42:34 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b708a-86d2-44d8-83c6-607d80a89fb6]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG os_brick.utils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating existing volume attachment record: addf7f22-614f-4a4e-8453-384a6fd06839 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:38 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:42:38 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:42:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.20983123779297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance f0794e7d-f909-456f-b9db-1aa833099848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d41a9954-e03a-42ce-bf0c-0ef7db1712c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a63ddb47-d6c2-48c2-9a43-a1a41583b3ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:42:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Creating image(s)
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk 1073741824" returned: 0 in 0.057s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Cannot resize image /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Ensure instance console log exists: /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Start _get_guest_xml network_info=[{"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '240cd94c-cfe6-47a0-a57e-90fd1266c7b5', 'attached_at': '', 'detached_at': '', 'volume_id': '3b473b12-917d-4dcb-af0f-43252ffb2607', 'serial': '3b473b12-917d-4dcb-af0f-43252ffb2607'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'addf7f22-614f-4a4e-8453-384a6fd06839', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:42:39 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 06:42:39 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'vcpu_model' on Instance uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:39 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:39 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:39 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3518ba-1e1e-4348-80dc-6f96679c598e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:42:39 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab009aa-a9e1-49dd-97b1-56ed76016bb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607] added
Nov 14 06:42:39 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ed0208-2340-4603-989c-12a78b3d2f86]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ed666e-dc0e-4096-a23a-22e8713ec0a3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziLthgbd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziLthgbd" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327bd57-05bc-4c4c-a503-7e4c1ce6748c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ziLthgbd'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9389c57-4780-4dbc-aedc-eeac45e9ad4a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b48efbc-f0b1-4ac3-9f5a-cc577ebfeb6c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee27998-63fa-4792-a334-8a3f5fdaab88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]
Nov 14 06:42:40 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.
Nov 14 06:42:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95788aae-b63a-47df-8b5d-56f7ccfb942b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[35939294-6589-4daf-8db5-4f62a26cb8ca]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:40 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a9c4b1-17ab-46d9-ba6d-72d5dd77f205]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:40 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26634633437333163', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633437333163', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1145897967',display_name='tempest-ServerActionsTestOtherA-server-972822708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1145897967',id=25,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPbmueRvQCp8NqHkCrl+yrPwaxMxP5J2NT2Vaf31oFT1IvlI4SpRwbDbYwalpjGLQ42o8e/fTVcgQdeljAR+QqIS0S6/rg56+UP5l+gTokPzLjG1IO6wP/2PyM7b0XJmw==',key_name='tempest-keypair-1203834143',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-cerjhtt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=240cd94c-cfe6-47a0-a57e-90fd1266c7b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:42:41 user nova-compute[75354]:   <uuid>240cd94c-cfe6-47a0-a57e-90fd1266c7b5</uuid>
Nov 14 06:42:41 user nova-compute[75354]:   <name>instance-00000019</name>
Nov 14 06:42:41 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:42:41 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:42:41 user nova-compute[75354]:   <metadata>
Nov 14 06:42:41 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:42:41 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:42:41 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherA-server-972822708</nova:name>
Nov 14 06:42:41 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:42:39</nova:creationTime>
Nov 14 06:42:41 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:42:41 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:42:41 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:42:41 user nova-compute[75354]:       <nova:owner>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:user uuid="4616257fc4344844a8a7913673ae0a6a">tempest-ServerActionsTestOtherA-834998162-project-member</nova:user>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:project uuid="85018ee44225437ab1d8b96c5fa4c408">tempest-ServerActionsTestOtherA-834998162</nova:project>
Nov 14 06:42:41 user nova-compute[75354]:       </nova:owner>
Nov 14 06:42:41 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:42:41 user nova-compute[75354]:       <nova:ports>
Nov 14 06:42:41 user nova-compute[75354]:         <nova:port uuid="b86aea79-d2dd-4944-8e2e-23b4a28fead6">
Nov 14 06:42:41 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:42:41 user nova-compute[75354]:         </nova:port>
Nov 14 06:42:41 user nova-compute[75354]:       </nova:ports>
Nov 14 06:42:41 user nova-compute[75354]:     </nova:instance>
Nov 14 06:42:41 user nova-compute[75354]:   </metadata>
Nov 14 06:42:41 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:42:41 user nova-compute[75354]:     <system>
Nov 14 06:42:41 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:42:41 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:42:41 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:42:41 user nova-compute[75354]:       <entry name="serial">240cd94c-cfe6-47a0-a57e-90fd1266c7b5</entry>
Nov 14 06:42:41 user nova-compute[75354]:       <entry name="uuid">240cd94c-cfe6-47a0-a57e-90fd1266c7b5</entry>
Nov 14 06:42:41 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:42:41 user nova-compute[75354]:     </system>
Nov 14 06:42:41 user nova-compute[75354]:   </sysinfo>
Nov 14 06:42:41 user nova-compute[75354]:   <os>
Nov 14 06:42:41 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:42:41 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:42:41 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:42:41 user nova-compute[75354]:   </os>
Nov 14 06:42:41 user nova-compute[75354]:   <features>
Nov 14 06:42:41 user nova-compute[75354]:     <acpi/>
Nov 14 06:42:41 user nova-compute[75354]:     <apic/>
Nov 14 06:42:41 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:42:41 user nova-compute[75354]:   </features>
Nov 14 06:42:41 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:42:41 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:42:41 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:42:41 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:42:41 user nova-compute[75354]:   </clock>
Nov 14 06:42:41 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:42:41 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:42:41 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:42:41 user nova-compute[75354]:   </cpu>
Nov 14 06:42:41 user nova-compute[75354]:   <devices>
Nov 14 06:42:41 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:42:41 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:42:41 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk"/>
Nov 14 06:42:41 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:42:41 user nova-compute[75354]:     </disk>
Nov 14 06:42:41 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:42:41 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:41 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 06:42:41 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:42:41 user nova-compute[75354]:       <serial>3b473b12-917d-4dcb-af0f-43252ffb2607</serial>
Nov 14 06:42:41 user nova-compute[75354]:     </disk>
Nov 14 06:42:41 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:42:41 user nova-compute[75354]:       <mac address="fa:16:3e:b4:90:8b"/>
Nov 14 06:42:41 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:42:41 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:42:41 user nova-compute[75354]:       <target dev="tapb86aea79-d2"/>
Nov 14 06:42:41 user nova-compute[75354]:     </interface>
Nov 14 06:42:41 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:42:41 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/console.log" append="off"/>
Nov 14 06:42:41 user nova-compute[75354]:     </serial>
Nov 14 06:42:41 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:42:41 user nova-compute[75354]:     <video>
Nov 14 06:42:41 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:42:41 user nova-compute[75354]:     </video>
Nov 14 06:42:41 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:42:41 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:42:41 user nova-compute[75354]:     </rng>
Nov 14 06:42:41 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:42:41 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:42:41 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:42:41 user nova-compute[75354]:     </memballoon>
Nov 14 06:42:41 user nova-compute[75354]:   </devices>
Nov 14 06:42:41 user nova-compute[75354]: </domain>
Nov 14 06:42:41 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1145897967',display_name='tempest-ServerActionsTestOtherA-server-972822708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1145897967',id=25,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPbmueRvQCp8NqHkCrl+yrPwaxMxP5J2NT2Vaf31oFT1IvlI4SpRwbDbYwalpjGLQ42o8e/fTVcgQdeljAR+QqIS0S6/rg56+UP5l+gTokPzLjG1IO6wP/2PyM7b0XJmw==',key_name='tempest-keypair-1203834143',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-cerjhtt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=240cd94c-cfe6-47a0-a57e-90fd1266c7b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG os_vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaf92334-86a0-52aa-8817-472cfa4c02b1', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb86aea79-d2, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb86aea79-d2, col_values=(('qos', UUID('2727332c-e45e-4d5a-a8ef-64763bcb36de')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb86aea79-d2, col_values=(('external_ids', {'iface-id': 'b86aea79-d2dd-4944-8e2e-23b4a28fead6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:90:8b', 'vm-uuid': '240cd94c-cfe6-47a0-a57e-90fd1266c7b5'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:41 user nova-compute[75354]: INFO os_vif [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2')
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:42:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No VIF found with MAC fa:16:3e:b4:90:8b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-158ef100-7ca4-425a-8913-13bd6a405776 req-7e3184e1-b513-4a74-86c5-ab30fe015178 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-158ef100-7ca4-425a-8913-13bd6a405776 req-7e3184e1-b513-4a74-86c5-ab30fe015178 service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-158ef100-7ca4-425a-8913-13bd6a405776 req-7e3184e1-b513-4a74-86c5-ab30fe015178 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-158ef100-7ca4-425a-8913-13bd6a405776 req-7e3184e1-b513-4a74-86c5-ab30fe015178 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-158ef100-7ca4-425a-8913-13bd6a405776 req-7e3184e1-b513-4a74-86c5-ab30fe015178 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:42 user nova-compute[75354]: WARNING nova.compute.manager [req-158ef100-7ca4-425a-8913-13bd6a405776 req-7e3184e1-b513-4a74-86c5-ab30fe015178 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 06:42:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:42:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance spawned successfully.
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-747e41e7-57a4-4ec1-8f3d-dbe04b58971e req-52e3b98a-16ca-4bb6-9a20-d44ce65ed55e service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-747e41e7-57a4-4ec1-8f3d-dbe04b58971e req-52e3b98a-16ca-4bb6-9a20-d44ce65ed55e service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-747e41e7-57a4-4ec1-8f3d-dbe04b58971e req-52e3b98a-16ca-4bb6-9a20-d44ce65ed55e service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-747e41e7-57a4-4ec1-8f3d-dbe04b58971e req-52e3b98a-16ca-4bb6-9a20-d44ce65ed55e service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-747e41e7-57a4-4ec1-8f3d-dbe04b58971e req-52e3b98a-16ca-4bb6-9a20-d44ce65ed55e service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:44 user nova-compute[75354]: WARNING nova.compute.manager [req-747e41e7-57a4-4ec1-8f3d-dbe04b58971e req-52e3b98a-16ca-4bb6-9a20-d44ce65ed55e service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 06:42:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75354) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 06:42:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d95682-8f2f-44f8-aa69-b5518473f8b9 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:42:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:42:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:42:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0794e7d-f909-456f-b9db-1aa833099848 is timed out.
Nov 14 06:42:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully detached device vdb from instance f0794e7d-f909-456f-b9db-1aa833099848 from the live domain config.
Nov 14 06:42:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQpzdRJL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:42:52 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d8167-80a3-4f58-9469-fb75cea4a5ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:42:52 user nova-compute[75354]: No targets found.
Nov 14 06:42:52 user nova-compute[75354]: iSNS:
Nov 14 06:42:52 user nova-compute[75354]: No targets found.
Nov 14 06:42:52 user nova-compute[75354]: STATIC:
Nov 14 06:42:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113
Nov 14 06:42:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:42:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:42:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:52 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b
Nov 14 06:42:52 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:42:52 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:42:52 user nova-compute[75354]: FIRMWARE:
Nov 14 06:42:52 user nova-compute[75354]: No targets found.
Nov 14 06:42:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:42:52 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:42:52 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb70e6e-e321-4fee-b25c-2991d5b2ea1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87173bd-28a4-4cfa-9045-db555a8fa766]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:52 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:52 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:52 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:42:52 user nova-compute[75354]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b (non-flash)
Nov 14 06:42:52 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:42:52 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:42:52 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741a3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76dc65-6642-4a6b-8c23-8b8a6e51ad5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ff9d7e-6c22-4708-9582-0c08612c0176]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[446007c3-9b74-4366-a49c-d6fb0a963316]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a8b90-4ebd-4d95-a6e4-3616b5767592]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7449e6-b895-422a-b03d-bc78f9ccd3b9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.125s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da0ae8-f7a1-4104-b3bb-95b7b8baeddb]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260]
Nov 14 06:42:53 user nova-compute[75354]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b, portal: 172.16.0.220,3260] successful.
Nov 14 06:42:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a2041b-6f8d-46bb-81eb-b4141328ac5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a517056-5b4f-4e0a-9c5b-97af7e7263ae]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== disconnect_volume: return (380ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-081f1206-b22c-44de-b2ff-8f56cc732293 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.978s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:54 user nova-compute[75354]: INFO nova.compute.manager [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Detaching volume bb9ce641-3f25-4517-99c7-e626a126b113
Nov 14 06:42:54 user nova-compute[75354]: INFO nova.virt.block_device [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Attempting to driver detach volume bb9ce641-3f25-4517-99c7-e626a126b113 from mountpoint /dev/vdc
Nov 14 06:42:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Attempting to detach device vdc from instance f0794e7d-f909-456f-b9db-1aa833099848 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:42:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:42:54 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:54 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:42:54 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:42:54 user nova-compute[75354]:   <serial>bb9ce641-3f25-4517-99c7-e626a126b113</serial>
Nov 14 06:42:54 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 06:42:54 user nova-compute[75354]: </disk>
Nov 14 06:42:54 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:42:54 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully detached device vdc from instance f0794e7d-f909-456f-b9db-1aa833099848 from the persistent domain config.
Nov 14 06:42:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f0794e7d-f909-456f-b9db-1aa833099848 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:42:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:42:54 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:42:54 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:42:54 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:42:54 user nova-compute[75354]:   <serial>bb9ce641-3f25-4517-99c7-e626a126b113</serial>
Nov 14 06:42:54 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 06:42:54 user nova-compute[75354]: </disk>
Nov 14 06:42:54 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:42:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:42:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:56 user nova-compute[75354]: INFO nova.compute.manager [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Terminating instance
Nov 14 06:42:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-973da7d3-c1b8-451e-9643-afec0dc13e75 req-86ef9a69-bc1a-4b48-93ec-18d87924d989 service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-vif-unplugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-973da7d3-c1b8-451e-9643-afec0dc13e75 req-86ef9a69-bc1a-4b48-93ec-18d87924d989 service nova] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-973da7d3-c1b8-451e-9643-afec0dc13e75 req-86ef9a69-bc1a-4b48-93ec-18d87924d989 service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-973da7d3-c1b8-451e-9643-afec0dc13e75 req-86ef9a69-bc1a-4b48-93ec-18d87924d989 service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-973da7d3-c1b8-451e-9643-afec0dc13e75 req-86ef9a69-bc1a-4b48-93ec-18d87924d989 service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] No waiting events found dispatching network-vif-unplugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-973da7d3-c1b8-451e-9643-afec0dc13e75 req-86ef9a69-bc1a-4b48-93ec-18d87924d989 service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-vif-unplugged-fb6f1139-c130-4cd6-bd14-08d1c900353d for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Instance destroyed successfully.
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.objects.instance [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lazy-loading 'resources' on Instance uuid d41a9954-e03a-42ce-bf0c-0ef7db1712c6 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1826004795',display_name='tempest-ServersNegativeTestJSON-server-1826004795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1826004795',id=26,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0829bb25ebb344eeb7cc2cfbb6990db0',ramdisk_id='',reservation_id='r-hcg8kfdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-906617313',owner_user_name='tempest-ServersNegativeTestJSON-906617313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:41:13Z,user_data=None,user_id='1d439693760147d2aab8152ac87480fa',uuid=d41a9954-e03a-42ce-bf0c-0ef7db1712c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converting VIF {"id": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "address": "fa:16:3e:fa:09:47", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6f1139-c1", "ovs_interfaceid": "fb6f1139-c130-4cd6-bd14-08d1c900353d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG os_vif [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb6f1139-c1, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e86c69ca-7c46-4e7e-98d5-d95db9d2dfa3) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:42:57 user nova-compute[75354]: INFO os_vif [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:09:47,bridge_name='br-int',has_traffic_filtering=True,id=fb6f1139-c130-4cd6-bd14-08d1c900353d,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6f1139-c1')
Nov 14 06:42:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Deleting instance files /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6_del
Nov 14 06:42:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Deletion of /opt/stack/data/nova/instances/d41a9954-e03a-42ce-bf0c-0ef7db1712c6_del complete
Nov 14 06:42:57 user nova-compute[75354]: INFO nova.compute.manager [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 14 06:42:57 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:42:57 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Took 0.53 seconds to deallocate network for instance.
Nov 14 06:42:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:58 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Deleted allocations for instance d41a9954-e03a-42ce-bf0c-0ef7db1712c6
Nov 14 06:42:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-3378ed58-7513-4018-901a-9015ddc9f238 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] Acquiring lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] Lock "d41a9954-e03a-42ce-bf0c-0ef7db1712c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:42:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] No waiting events found dispatching network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:42:58 user nova-compute[75354]: WARNING nova.compute.manager [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received unexpected event network-vif-plugged-fb6f1139-c130-4cd6-bd14-08d1c900353d for instance with vm_state deleted and task_state None.
Nov 14 06:42:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-1f55d24a-b873-4f2a-bfc7-150d4ee195eb req-bd3bbdda-05ff-4261-a301-770ed068633a service nova] [instance: d41a9954-e03a-42ce-bf0c-0ef7db1712c6] Received event network-vif-deleted-fb6f1139-c130-4cd6-bd14-08d1c900353d {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:15 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f0794e7d-f909-456f-b9db-1aa833099848 is timed out.
Nov 14 06:43:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully detached device vdc from instance f0794e7d-f909-456f-b9db-1aa833099848 from the live domain config.
Nov 14 06:43:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvfHZKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:43:15 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ed0d5b-bc21-4d5c-8a3e-48fc09133bd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:43:15 user nova-compute[75354]: No targets found.
Nov 14 06:43:15 user nova-compute[75354]: iSNS:
Nov 14 06:43:15 user nova-compute[75354]: No targets found.
Nov 14 06:43:15 user nova-compute[75354]: STATIC:
Nov 14 06:43:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113
Nov 14 06:43:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:43:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:43:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:43:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:43:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:43:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:43:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:43:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:43:15 user nova-compute[75354]: FIRMWARE:
Nov 14 06:43:15 user nova-compute[75354]: No targets found.
Nov 14 06:43:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:43:15 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:43:15 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb86fb-5a02-44c5-97b6-514e129df0a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeacf077-4faa-4195-bde8-bfac835b3ec0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:43:15 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:43:15 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:43:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:43:15 user nova-compute[75354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 (non-flash)
Nov 14 06:43:15 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:43:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80943e2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22d6f6-3867-4a00-9066-02cce0eabee9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db10287-4178-4ad8-a07b-2140dcd22924]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b04a0f-22a0-4bea-9430-dbe9d3e999a3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a24e0-351d-4a6b-88fa-42a7618e4658]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdd8b92-2a7c-435b-94f0-f7600d4bb52a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29428f-dbd5-4448-90f3-19792a9824a9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260]
Nov 14 06:43:15 user nova-compute[75354]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113, portal: 172.16.0.220,3260] successful.
Nov 14 06:43:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9ce641-3f25-4517-99c7-e626a126b113 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece296b-23f4-4512-a8e1-f137511dccfd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] <== disconnect_volume: return (312ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:43:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:43:16 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'flavor' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd89ef69-818f-465b-b37d-688549b2b77f tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.609s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:17 user nova-compute[75354]: INFO nova.compute.manager [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Terminating instance
Nov 14 06:43:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4bde1bba-b1e9-41f0-89ee-83f12b7cd697 req-deb35847-7420-4ce9-9102-b418feb8e035 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-vif-unplugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4bde1bba-b1e9-41f0-89ee-83f12b7cd697 req-deb35847-7420-4ce9-9102-b418feb8e035 service nova] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4bde1bba-b1e9-41f0-89ee-83f12b7cd697 req-deb35847-7420-4ce9-9102-b418feb8e035 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4bde1bba-b1e9-41f0-89ee-83f12b7cd697 req-deb35847-7420-4ce9-9102-b418feb8e035 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4bde1bba-b1e9-41f0-89ee-83f12b7cd697 req-deb35847-7420-4ce9-9102-b418feb8e035 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] No waiting events found dispatching network-vif-unplugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:43:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4bde1bba-b1e9-41f0-89ee-83f12b7cd697 req-deb35847-7420-4ce9-9102-b418feb8e035 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-vif-unplugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:43:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Instance destroyed successfully.
Nov 14 06:43:18 user nova-compute[75354]: DEBUG nova.objects.instance [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lazy-loading 'resources' on Instance uuid f0794e7d-f909-456f-b9db-1aa833099848 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2024923655',display_name='tempest-AttachVolumeTestJSON-server-2024923655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2024923655',id=24,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0YyaiK1ivkie7mmBIecrr8LatwMJZGkIjy2mXeXnpxm12deI+2uewaDmkHJUIVbqKxhQ2NRfN849cuJc669WaJVcK7ypO0pWbQEJVRsVkITsD6CNJvDtACRlf6SoeMAQ==',key_name='tempest-keypair-1822276340',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f809549aa1ea440abaef3e4ba37ca414',ramdisk_id='',reservation_id='r-1a260eca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353209128',owner_user_name='tempest-AttachVolumeTestJSON-1353209128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43461d505f5f44d68823f9c9e67f1cf4',uuid=f0794e7d-f909-456f-b9db-1aa833099848,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converting VIF {"id": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "address": "fa:16:3e:9e:bd:c6", "network": {"id": "b16610ae-bc02-44f0-b866-2530cedb7845", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-241014231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f809549aa1ea440abaef3e4ba37ca414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42699268-e3", "ovs_interfaceid": "42699268-e3da-4ff4-b5f0-8e86e29b1162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG os_vif [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42699268-e3, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a68f0d4-0c84-43a2-96a3-11c18e80bd8a) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:18 user nova-compute[75354]: INFO os_vif [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:bd:c6,bridge_name='br-int',has_traffic_filtering=True,id=42699268-e3da-4ff4-b5f0-8e86e29b1162,network=Network(b16610ae-bc02-44f0-b866-2530cedb7845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42699268-e3')
Nov 14 06:43:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Deleting instance files /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848_del
Nov 14 06:43:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Deletion of /opt/stack/data/nova/instances/f0794e7d-f909-456f-b9db-1aa833099848_del complete
Nov 14 06:43:18 user nova-compute[75354]: INFO nova.compute.manager [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 06:43:18 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:43:18 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: f0794e7d-f909-456f-b9db-1aa833099848] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:19 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Took 0.68 seconds to deallocate network for instance.
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:19 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Deleted allocations for instance f0794e7d-f909-456f-b9db-1aa833099848
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afe21742-cf38-4237-a6fe-2b088279c262 tempest-AttachVolumeTestJSON-1353209128 tempest-AttachVolumeTestJSON-1353209128-project-member] Lock "f0794e7d-f909-456f-b9db-1aa833099848" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] Acquiring lock "f0794e7d-f909-456f-b9db-1aa833099848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] Lock "f0794e7d-f909-456f-b9db-1aa833099848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] No waiting events found dispatching network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:43:19 user nova-compute[75354]: WARNING nova.compute.manager [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received unexpected event network-vif-plugged-42699268-e3da-4ff4-b5f0-8e86e29b1162 for instance with vm_state deleted and task_state None.
Nov 14 06:43:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-a30cda86-fa42-4efe-91e2-b27caee63bbc req-80c8771d-e352-492d-b91c-d60bd4a279b8 service nova] [instance: f0794e7d-f909-456f-b9db-1aa833099848] Received event network-vif-deleted-42699268-e3da-4ff4-b5f0-8e86e29b1162 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:43:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:43:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:43:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:43:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:38 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:43:38 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=25.224056243896484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a63ddb47-d6c2-48c2-9a43-a1a41583b3ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:43:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-changed-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Refreshing instance network info cache due to event network-changed-b217109c-5da7-4c36-a2e3-6949fb230bc3. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] Acquiring lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] Acquired lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG nova.network.neutron [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Refreshing network info cache for port b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'flavor' on Instance uuid a7341396-5af8-4616-95d3-9cdb8c6e0a72 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Ignoring supplied device name: /dev/vdb
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:41 user nova-compute[75354]: INFO nova.compute.manager [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Attaching volume 04e9f8f6-8218-4db9-88c8-c154356fec2d to /dev/vdb
Nov 14 06:43:41 user nova-compute[75354]: DEBUG nova.network.neutron [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updated VIF entry in instance network info cache for port b217109c-5da7-4c36-a2e3-6949fb230bc3. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG nova.network.neutron [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updating instance_info_cache with network_info: [{"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-082d51fb-448a-45cc-8326-156456a2ee75 req-994e128b-995c-4f3f-a87b-da95bfde4441 service nova] Releasing lock "refresh_cache-a7341396-5af8-4616-95d3-9cdb8c6e0a72" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG os_brick.utils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd8d3c0-d467-4a29-b882-921f38ab52f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5194d040-6055-4dc4-be63-b67f3fab7730]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cb26f7-8595-4c4e-92e6-70159fe13590]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef4933-96c2-4b3a-bb1d-bd6b742dd6ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:43:42 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:43:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03227f-8c29-45be-8cdf-33a1fc2ff3c4]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG os_brick.utils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:43:42 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updating existing volume attachment record: d4986f9a-e0dd-4aa4-b8cb-8875033c8c2a {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing instance network info cache due to event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updated VIF entry in instance network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-625ecf40-6845-4135-a2e0-ab5978ab43b6 req-9fc8e8eb-6e6d-4c72-bbd0-1d05dc71b403 service nova] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [{"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-dce2abf5-a489-4d92-8a91-b3f436c53a50" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvCitKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:43:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:43:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:43:46 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9937007-f4e3-466e-b8b8-9f99bc711b8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:43:46 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5037ba-9441-4ab9-bc7b-05532007e9b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d] added
Nov 14 06:43:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ccf80-04ce-4d92-9b4c-0dd6df959452]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d61c7-79d6-46ce-9211-f1810de428e1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvCitKyr {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvCitKyr" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[526bf603-343c-4182-b69a-49ecb1f0ee45]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XvCitKyr'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ad613-3dc1-4a10-8853-5792c981d952]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74e740-4bac-473c-8dbe-1183f39b9aa5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2326ca68-db17-40f3-bc6e-279639f2ba51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260]
Nov 14 06:43:46 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260] successful.
Nov 14 06:43:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b193cee4-f546-4a0d-a749-2a92c0d38ab8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e01316c-3d35-4a0a-9a8b-2d31f482bf01]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:43:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:43:46 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:43:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aebaef3-24e6-4926-82cd-e81b7e6bc0a5]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvCitKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:43:46 user nova-compute[75354]: INFO nova.compute.claims [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Claim successful on node user
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:47 user nova-compute[75354]: INFO nova.compute.manager [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Shelving
Nov 14 06:43:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:43:47 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-4a947ca4-0933-4583-a812-43559f14845f req-57412fe8-9d4c-4ef4-b116-d9ec6afc8634 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-unplugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4a947ca4-0933-4583-a812-43559f14845f req-57412fe8-9d4c-4ef4-b116-d9ec6afc8634 service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4a947ca4-0933-4583-a812-43559f14845f req-57412fe8-9d4c-4ef4-b116-d9ec6afc8634 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4a947ca4-0933-4583-a812-43559f14845f req-57412fe8-9d4c-4ef4-b116-d9ec6afc8634 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-4a947ca4-0933-4583-a812-43559f14845f req-57412fe8-9d4c-4ef4-b116-d9ec6afc8634 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-unplugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:43:47 user nova-compute[75354]: WARNING nova.compute.manager [req-4a947ca4-0933-4583-a812-43559f14845f req-57412fe8-9d4c-4ef4-b116-d9ec6afc8634 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-unplugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state active and task_state shelving.
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.policy [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfc31b05a2848128a837f170ac63b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0fdd525e8a49aeac22892962d8b14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:43:47 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Creating image(s)
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23233356365396263', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233356365396263', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'flavor' on Instance uuid a7341396-5af8-4616-95d3-9cdb8c6e0a72 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:43:47 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:43:47 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:43:47 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:43:47 user nova-compute[75354]:   <serial>04e9f8f6-8218-4db9-88c8-c154356fec2d</serial>
Nov 14 06:43:47 user nova-compute[75354]: </disk>
Nov 14 06:43:47 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk 1073741824" returned: 0 in 0.053s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance destroyed successfully.
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] No VIF found with MAC fa:16:3e:07:65:97, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:43:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Beginning cold snapshot process
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.197s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Successfully created port: 46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk /opt/stack/data/nova/instances/snapshots/tmpopgnrsyz/eed5ffb8864a49f49108253d3ce81b58 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1ae4a1b5-1d8c-4d52-9967-c28821cd01aa tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.543s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Cannot resize image /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Ensure instance console log exists: /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk /opt/stack/data/nova/instances/snapshots/tmpopgnrsyz/eed5ffb8864a49f49108253d3ce81b58" returned: 0 in 0.735s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:43:49 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Snapshot extracted, beginning image upload
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Successfully updated port: 46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-6f9d03ba-4080-4c18-a998-2d0bed6fcb82" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-6f9d03ba-4080-4c18-a998-2d0bed6fcb82" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:43:49 user nova-compute[75354]: WARNING nova.compute.manager [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-changed-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Refreshing instance network info cache due to event network-changed-46df7cd5-e452-48c7-8122-48ff4064f5a1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] Acquiring lock "refresh_cache-6f9d03ba-4080-4c18-a998-2d0bed6fcb82" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Updating instance_info_cache with network_info: [{"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-6f9d03ba-4080-4c18-a998-2d0bed6fcb82" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Instance network_info: |[{"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] Acquired lock "refresh_cache-6f9d03ba-4080-4c18-a998-2d0bed6fcb82" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Refreshing network info cache for port 46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Start _get_guest_xml network_info=[{"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:43:49 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:43:49 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-170344645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-170344645',id=30,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-0r1hu0ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:43:47Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=6f9d03ba-4080-4c18-a998-2d0bed6fcb82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.objects.instance [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:43:49 user nova-compute[75354]:   <uuid>6f9d03ba-4080-4c18-a998-2d0bed6fcb82</uuid>
Nov 14 06:43:49 user nova-compute[75354]:   <name>instance-0000001e</name>
Nov 14 06:43:49 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:43:49 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:43:49 user nova-compute[75354]:   <metadata>
Nov 14 06:43:49 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:43:49 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:43:49 user nova-compute[75354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-170344645</nova:name>
Nov 14 06:43:49 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:43:49</nova:creationTime>
Nov 14 06:43:49 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:43:49 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:43:49 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:43:49 user nova-compute[75354]:       <nova:owner>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:user uuid="2dfc31b05a2848128a837f170ac63b93">tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member</nova:user>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:project uuid="7e0fdd525e8a49aeac22892962d8b14e">tempest-ServerBootFromVolumeStableRescueTest-1883221150</nova:project>
Nov 14 06:43:49 user nova-compute[75354]:       </nova:owner>
Nov 14 06:43:49 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:43:49 user nova-compute[75354]:       <nova:ports>
Nov 14 06:43:49 user nova-compute[75354]:         <nova:port uuid="46df7cd5-e452-48c7-8122-48ff4064f5a1">
Nov 14 06:43:49 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 06:43:49 user nova-compute[75354]:         </nova:port>
Nov 14 06:43:49 user nova-compute[75354]:       </nova:ports>
Nov 14 06:43:49 user nova-compute[75354]:     </nova:instance>
Nov 14 06:43:49 user nova-compute[75354]:   </metadata>
Nov 14 06:43:49 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:43:49 user nova-compute[75354]:     <system>
Nov 14 06:43:49 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:43:49 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:43:49 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:43:49 user nova-compute[75354]:       <entry name="serial">6f9d03ba-4080-4c18-a998-2d0bed6fcb82</entry>
Nov 14 06:43:49 user nova-compute[75354]:       <entry name="uuid">6f9d03ba-4080-4c18-a998-2d0bed6fcb82</entry>
Nov 14 06:43:49 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:43:49 user nova-compute[75354]:     </system>
Nov 14 06:43:49 user nova-compute[75354]:   </sysinfo>
Nov 14 06:43:49 user nova-compute[75354]:   <os>
Nov 14 06:43:49 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:43:49 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:43:49 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:43:49 user nova-compute[75354]:   </os>
Nov 14 06:43:49 user nova-compute[75354]:   <features>
Nov 14 06:43:49 user nova-compute[75354]:     <acpi/>
Nov 14 06:43:49 user nova-compute[75354]:     <apic/>
Nov 14 06:43:49 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:43:49 user nova-compute[75354]:   </features>
Nov 14 06:43:49 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:43:49 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:43:49 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:43:49 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:43:49 user nova-compute[75354]:   </clock>
Nov 14 06:43:49 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:43:49 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:43:49 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:43:49 user nova-compute[75354]:   </cpu>
Nov 14 06:43:49 user nova-compute[75354]:   <devices>
Nov 14 06:43:49 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:43:49 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:43:49 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk"/>
Nov 14 06:43:49 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:43:49 user nova-compute[75354]:     </disk>
Nov 14 06:43:49 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:43:49 user nova-compute[75354]:       <mac address="fa:16:3e:15:39:78"/>
Nov 14 06:43:49 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:43:49 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:43:49 user nova-compute[75354]:       <target dev="tap46df7cd5-e4"/>
Nov 14 06:43:49 user nova-compute[75354]:     </interface>
Nov 14 06:43:49 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:43:49 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/console.log" append="off"/>
Nov 14 06:43:49 user nova-compute[75354]:     </serial>
Nov 14 06:43:49 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:43:49 user nova-compute[75354]:     <video>
Nov 14 06:43:49 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:43:49 user nova-compute[75354]:     </video>
Nov 14 06:43:49 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:43:49 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:43:49 user nova-compute[75354]:     </rng>
Nov 14 06:43:49 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:43:49 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:43:49 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:43:49 user nova-compute[75354]:     </memballoon>
Nov 14 06:43:49 user nova-compute[75354]:   </devices>
Nov 14 06:43:49 user nova-compute[75354]: </domain>
Nov 14 06:43:49 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-170344645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-170344645',id=30,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-0r1hu0ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:43:47Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=6f9d03ba-4080-4c18-a998-2d0bed6fcb82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG os_vif [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21d65237-1500-5dbd-8b9e-160fb3126a10', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46df7cd5-e4, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46df7cd5-e4, col_values=(('qos', UUID('0ecc40d7-c290-425a-a2de-5d5d4fed7b42')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46df7cd5-e4, col_values=(('external_ids', {'iface-id': '46df7cd5-e452-48c7-8122-48ff4064f5a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:39:78', 'vm-uuid': '6f9d03ba-4080-4c18-a998-2d0bed6fcb82'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:49 user nova-compute[75354]: INFO os_vif [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4')
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No VIF found with MAC fa:16:3e:15:39:78, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Updated VIF entry in instance network info cache for port 46df7cd5-e452-48c7-8122-48ff4064f5a1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG nova.network.neutron [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Updating instance_info_cache with network_info: [{"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17d26b62-299d-4602-86eb-5657e0556db3 req-fa1dd10c-dd9f-4b59-8611-cc3c07b2dc7e service nova] Releasing lock "refresh_cache-6f9d03ba-4080-4c18-a998-2d0bed6fcb82" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-fab9c09f-a7a8-4182-8595-a6d0d2d3287f req-dc8b85c5-d350-494c-8449-c0362495bd64 service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fab9c09f-a7a8-4182-8595-a6d0d2d3287f req-dc8b85c5-d350-494c-8449-c0362495bd64 service nova] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fab9c09f-a7a8-4182-8595-a6d0d2d3287f req-dc8b85c5-d350-494c-8449-c0362495bd64 service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fab9c09f-a7a8-4182-8595-a6d0d2d3287f req-dc8b85c5-d350-494c-8449-c0362495bd64 service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-fab9c09f-a7a8-4182-8595-a6d0d2d3287f req-dc8b85c5-d350-494c-8449-c0362495bd64 service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] No waiting events found dispatching network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:43:51 user nova-compute[75354]: WARNING nova.compute.manager [req-fab9c09f-a7a8-4182-8595-a6d0d2d3287f req-dc8b85c5-d350-494c-8449-c0362495bd64 service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received unexpected event network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 for instance with vm_state building and task_state spawning.
Nov 14 06:43:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Snapshot image upload complete
Nov 14 06:43:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:43:51 user nova-compute[75354]: INFO nova.compute.manager [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Shelve offloading
Nov 14 06:43:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance destroyed successfully.
Nov 14 06:43:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:51 user nova-compute[75354]: DEBUG nova.network.neutron [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance destroyed successfully.
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'resources' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904050191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904050191',id=28,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1A3A9BcukZawHUjUEds9uc2Hcqr3jc5IY1p1IsXGtKSxB2rzUy15LsDIcKRGb/seUMdkbYxF0qk5yDP2v6y27ASZXAnCQbMDyzSdmof3YH+PONl7tETrcpVZBF2t6G0g==',key_name='tempest-keypair-1737925936',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-p90j785d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member',shelved_at='2023-11-14T06:43:51.852911',shelved_host='user',shelved_image_id='63bd70c5-a6c2-4503-a935-1a18edef675d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=a63ddb47-d6c2-48c2-9a43-a1a41583b3ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG os_vif [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa23886d-d7, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing instance network info cache due to event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9f329b3-c4fa-4101-ba72-f43b85aa43dd) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:52 user nova-compute[75354]: INFO os_vif [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7')
Nov 14 06:43:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Deleting instance files /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca_del
Nov 14 06:43:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Deletion of /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca_del complete
Nov 14 06:43:52 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Deleted allocations for instance a63ddb47-d6c2-48c2-9a43-a1a41583b3ca
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'numa_topology' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.objects.base [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<a63ddb47-d6c2-48c2-9a43-a1a41583b3ca> lazy-loaded attributes: resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:43:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Instance spawned successfully.
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updated VIF entry in instance network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfa23886d-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-cfcf4025-3f1b-4e3d-9c05-4e3e0aaef80a req-3adb050d-6d03-4263-ab88-6e6745cb40d6 service nova] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:43:53 user nova-compute[75354]: INFO nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:43:53 user nova-compute[75354]: INFO nova.compute.manager [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Took 6.55 seconds to build instance.
Nov 14 06:43:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ee7b3c6-a403-4c4e-ae00-4f1a7911d71c req-91b644ec-c975-4c75-99d4-14462efb223c service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ee7b3c6-a403-4c4e-ae00-4f1a7911d71c req-91b644ec-c975-4c75-99d4-14462efb223c service nova] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ee7b3c6-a403-4c4e-ae00-4f1a7911d71c req-91b644ec-c975-4c75-99d4-14462efb223c service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ee7b3c6-a403-4c4e-ae00-4f1a7911d71c req-91b644ec-c975-4c75-99d4-14462efb223c service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ee7b3c6-a403-4c4e-ae00-4f1a7911d71c req-91b644ec-c975-4c75-99d4-14462efb223c service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] No waiting events found dispatching network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:43:53 user nova-compute[75354]: WARNING nova.compute.manager [req-4ee7b3c6-a403-4c4e-ae00-4f1a7911d71c req-91b644ec-c975-4c75-99d4-14462efb223c service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received unexpected event network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 for instance with vm_state active and task_state None.
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0831d619-d62d-4c93-b386-32c5e332ef90 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.656s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-edaf8aa7-af85-4f4f-ace6-68ac17802d3b tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.321s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:43:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:43:55 user nova-compute[75354]: INFO nova.compute.manager [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Detaching volume 04e9f8f6-8218-4db9-88c8-c154356fec2d
Nov 14 06:43:55 user nova-compute[75354]: INFO nova.virt.block_device [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Attempting to driver detach volume 04e9f8f6-8218-4db9-88c8-c154356fec2d from mountpoint /dev/vdb
Nov 14 06:43:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Attempting to detach device vdb from instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:43:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:43:55 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:43:55 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:43:55 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:43:55 user nova-compute[75354]:   <serial>04e9f8f6-8218-4db9-88c8-c154356fec2d</serial>
Nov 14 06:43:55 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:43:55 user nova-compute[75354]: </disk>
Nov 14 06:43:55 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:43:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully detached device vdb from instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 from the persistent domain config.
Nov 14 06:43:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:43:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:43:55 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:43:55 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 06:43:55 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:43:55 user nova-compute[75354]:   <serial>04e9f8f6-8218-4db9-88c8-c154356fec2d</serial>
Nov 14 06:43:55 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:43:55 user nova-compute[75354]: </disk>
Nov 14 06:43:55 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:43:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:43:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:43:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:43:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing instance network info cache due to event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:44:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:44:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:44:01 user nova-compute[75354]: DEBUG nova.network.neutron [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'flavor' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:02 user nova-compute[75354]: INFO nova.compute.manager [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Attaching volume 9c047d94-b532-4eb8-abef-5348ecc43ff5 to /dev/vdb
Nov 14 06:44:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updated VIF entry in instance network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1c2fbc4f-ec82-40c3-81be-853858a34479 req-d1bd6a64-2b56-42c1-ac5e-b9bd3f0447a3 service nova] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG os_brick.utils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31029de6-d2d8-47b5-a6a0-1877f1c087a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb61ee8-697d-45c0-9dd2-1291f42f56e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5bb18d-dd9b-4a61-90de-c6e05f24f75e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ad68fa-0ba1-4e06-b1bb-95fad919c401]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:44:02 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:44:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a463726-30ca-47ee-9fdf-f2e311c603fe]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG os_brick.utils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating existing volume attachment record: 76692add-1148-48fd-9a65-b15e3c097729 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:44:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBvmINxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:44:06 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:44:06 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:44:06 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd820915-7ee1-4777-9f8b-2d697e0a753a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:44:06 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c6707f-82ee-4176-b4e8-d08f6c1ebfef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5] added
Nov 14 06:44:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f2e8f-b1e3-455d-a474-7f2b34d3d48e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77812f93-36b5-48d6-9575-473de805448e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBvmINxE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBvmINxE" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9dbbe-6356-443e-a530-fd9f78ecdcd4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBvmINxE'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d948b6d-baea-4bfa-aa7a-f49bfc995597]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a542f-ce6c-40a6-8fe7-d5c8ca9d10ea]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:44:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:44:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b1b84-d238-4fd6-9f51-ac08c1b3bcf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260]
Nov 14 06:44:06 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260] successful.
Nov 14 06:44:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3bcb9-8897-4978-a709-8763d9b072a3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bca7c8-ee4f-4f9d-bf77-da9eb2a1005b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:44:06 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:44:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:44:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[538733e4-56bc-45c3-9e12-88855dfbd6e4]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:44:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBvmINxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:44:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23930333566663164', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930333566663164', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'flavor' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:44:08 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:44:08 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:44:08 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:44:08 user nova-compute[75354]:   <serial>9c047d94-b532-4eb8-abef-5348ecc43ff5</serial>
Nov 14 06:44:08 user nova-compute[75354]: </disk>
Nov 14 06:44:08 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:24:20:23, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8f09dfc8-40f3-4fde-804a-8a2d7100336c tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.442s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:09 user nova-compute[75354]: INFO nova.compute.manager [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Rescuing
Nov 14 06:44:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:44:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:44:09 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-f67c54cd-c84c-49c8-a232-0299efe53358 req-27ee0780-9f64-4f03-ab1f-93e7d6c7e22e service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f67c54cd-c84c-49c8-a232-0299efe53358 req-27ee0780-9f64-4f03-ab1f-93e7d6c7e22e service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f67c54cd-c84c-49c8-a232-0299efe53358 req-27ee0780-9f64-4f03-ab1f-93e7d6c7e22e service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f67c54cd-c84c-49c8-a232-0299efe53358 req-27ee0780-9f64-4f03-ab1f-93e7d6c7e22e service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-f67c54cd-c84c-49c8-a232-0299efe53358 req-27ee0780-9f64-4f03-ab1f-93e7d6c7e22e service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:44:11 user nova-compute[75354]: WARNING nova.compute.manager [req-f67c54cd-c84c-49c8-a232-0299efe53358 req-27ee0780-9f64-4f03-ab1f-93e7d6c7e22e service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state active and task_state rescuing.
Nov 14 06:44:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance destroyed successfully.
Nov 14 06:44:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Attempting rescue
Nov 14 06:44:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:44:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Creating image(s)
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'trusted_certs' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'migration_context' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.base [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<852ddc06-5bfb-42d9-bfb4-74fc93ab3a58> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Start _get_guest_xml network_info=[{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:24:20:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '013c3665-3f76-488b-92b6-f08787e9badf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'resources' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.base [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<852ddc06-5bfb-42d9-bfb4-74fc93ab3a58> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'numa_topology' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.base [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<852ddc06-5bfb-42d9-bfb4-74fc93ab3a58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:44:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:44:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'vcpu_model' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.base [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<852ddc06-5bfb-42d9-bfb4-74fc93ab3a58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83301515',display_name='tempest-ServerRescueNegativeTestJSON-server-83301515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83301515',id=29,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa2ds0jIml6nHt0nv3LhtVzVQ3D8kB2BL2c4R8ovmhPqGlvlgZQDtSKINF1zixKNX2QobsqBJzwO93FVaY9Kx+iE/W27SV50I3QqNpqSwmz0IuH8rgatDP4wwv3EFMLNQ==',key_name='tempest-keypair-49713527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-22b8wu0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=852ddc06-5bfb-42d9-bfb4-74fc93ab3a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:24:20:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "vif_mac": "fa:16:3e:24:20:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'pci_devices' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.objects.base [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Object Instance<852ddc06-5bfb-42d9-bfb4-74fc93ab3a58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:44:12 user nova-compute[75354]:   <uuid>852ddc06-5bfb-42d9-bfb4-74fc93ab3a58</uuid>
Nov 14 06:44:12 user nova-compute[75354]:   <name>instance-0000001d</name>
Nov 14 06:44:12 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:44:12 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:44:12 user nova-compute[75354]:   <metadata>
Nov 14 06:44:12 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:44:12 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:44:12 user nova-compute[75354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-83301515</nova:name>
Nov 14 06:44:12 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:44:12</nova:creationTime>
Nov 14 06:44:12 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:44:12 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:44:12 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:44:12 user nova-compute[75354]:       <nova:owner>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:user uuid="7f141a1ef1b44b34b09a8f2f88d5af17">tempest-ServerRescueNegativeTestJSON-2059994566-project-member</nova:user>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:project uuid="601a7175bd194f79b4ae31d34f724de4">tempest-ServerRescueNegativeTestJSON-2059994566</nova:project>
Nov 14 06:44:12 user nova-compute[75354]:       </nova:owner>
Nov 14 06:44:12 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:44:12 user nova-compute[75354]:       <nova:ports>
Nov 14 06:44:12 user nova-compute[75354]:         <nova:port uuid="4dfd73ae-d00c-48d3-bd36-d25bbdf8b336">
Nov 14 06:44:12 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 06:44:12 user nova-compute[75354]:         </nova:port>
Nov 14 06:44:12 user nova-compute[75354]:       </nova:ports>
Nov 14 06:44:12 user nova-compute[75354]:     </nova:instance>
Nov 14 06:44:12 user nova-compute[75354]:   </metadata>
Nov 14 06:44:12 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:44:12 user nova-compute[75354]:     <system>
Nov 14 06:44:12 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:44:12 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:44:12 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:44:12 user nova-compute[75354]:       <entry name="serial">852ddc06-5bfb-42d9-bfb4-74fc93ab3a58</entry>
Nov 14 06:44:12 user nova-compute[75354]:       <entry name="uuid">852ddc06-5bfb-42d9-bfb4-74fc93ab3a58</entry>
Nov 14 06:44:12 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:44:12 user nova-compute[75354]:     </system>
Nov 14 06:44:12 user nova-compute[75354]:   </sysinfo>
Nov 14 06:44:12 user nova-compute[75354]:   <os>
Nov 14 06:44:12 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:44:12 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:44:12 user nova-compute[75354]:   </os>
Nov 14 06:44:12 user nova-compute[75354]:   <features>
Nov 14 06:44:12 user nova-compute[75354]:     <acpi/>
Nov 14 06:44:12 user nova-compute[75354]:     <apic/>
Nov 14 06:44:12 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:44:12 user nova-compute[75354]:   </features>
Nov 14 06:44:12 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:44:12 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:44:12 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:44:12 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:44:12 user nova-compute[75354]:   </clock>
Nov 14 06:44:12 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:44:12 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:44:12 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:44:12 user nova-compute[75354]:   </cpu>
Nov 14 06:44:12 user nova-compute[75354]:   <devices>
Nov 14 06:44:12 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:44:12 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:44:12 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue"/>
Nov 14 06:44:12 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:44:12 user nova-compute[75354]:     </disk>
Nov 14 06:44:12 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:44:12 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:44:12 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk"/>
Nov 14 06:44:12 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:44:12 user nova-compute[75354]:     </disk>
Nov 14 06:44:12 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:44:12 user nova-compute[75354]:       <mac address="fa:16:3e:24:20:23"/>
Nov 14 06:44:12 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:44:12 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:44:12 user nova-compute[75354]:       <target dev="tap4dfd73ae-d0"/>
Nov 14 06:44:12 user nova-compute[75354]:     </interface>
Nov 14 06:44:12 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:44:12 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/console.log" append="off"/>
Nov 14 06:44:12 user nova-compute[75354]:     </serial>
Nov 14 06:44:12 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:44:12 user nova-compute[75354]:     <video>
Nov 14 06:44:12 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:44:12 user nova-compute[75354]:     </video>
Nov 14 06:44:12 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:44:12 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:44:12 user nova-compute[75354]:     </rng>
Nov 14 06:44:12 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:44:12 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:44:12 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:44:12 user nova-compute[75354]:     </memballoon>
Nov 14 06:44:12 user nova-compute[75354]:   </devices>
Nov 14 06:44:12 user nova-compute[75354]: </domain>
Nov 14 06:44:12 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:44:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance destroyed successfully.
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] No VIF found with MAC fa:16:3e:24:20:23, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:44:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-411ba0c8-346e-41ee-b559-62d3325875a2 req-2b6d6865-b5ca-4fe5-9059-392d4fdb497b service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-411ba0c8-346e-41ee-b559-62d3325875a2 req-2b6d6865-b5ca-4fe5-9059-392d4fdb497b service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-411ba0c8-346e-41ee-b559-62d3325875a2 req-2b6d6865-b5ca-4fe5-9059-392d4fdb497b service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-411ba0c8-346e-41ee-b559-62d3325875a2 req-2b6d6865-b5ca-4fe5-9059-392d4fdb497b service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-411ba0c8-346e-41ee-b559-62d3325875a2 req-2b6d6865-b5ca-4fe5-9059-392d4fdb497b service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:44:13 user nova-compute[75354]: WARNING nova.compute.manager [req-411ba0c8-346e-41ee-b559-62d3325875a2 req-2b6d6865-b5ca-4fe5-9059-392d4fdb497b service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state active and task_state rescuing.
Nov 14 06:44:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:44:15 user nova-compute[75354]: WARNING nova.compute.manager [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state active and task_state rescuing.
Nov 14 06:44:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:44:15 user nova-compute[75354]: WARNING nova.compute.manager [req-efafbce5-08a2-4137-a5cd-981d0723c40f req-beaca57e-7c4f-4767-a689-e2383e590ac1 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state active and task_state rescuing.
Nov 14 06:44:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a78b0978-e065-4c3e-bbe2-f52e8b7306ac tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:44:15 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 is timed out.
Nov 14 06:44:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully detached device vdb from instance a7341396-5af8-4616-95d3-9cdb8c6e0a72 from the live domain config.
Nov 14 06:44:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvCitKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:44:15 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:44:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c51d4c-2dde-4a96-acf4-e51ef35accd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:44:15 user nova-compute[75354]: No targets found.
Nov 14 06:44:15 user nova-compute[75354]: iSNS:
Nov 14 06:44:15 user nova-compute[75354]: No targets found.
Nov 14 06:44:15 user nova-compute[75354]: STATIC:
Nov 14 06:44:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5
Nov 14 06:44:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:44:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:44:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:15 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d
Nov 14 06:44:15 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:15 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:15 user nova-compute[75354]: FIRMWARE:
Nov 14 06:44:15 user nova-compute[75354]: No targets found.
Nov 14 06:44:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:44:15 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:44:15 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171faae-ea8f-4ef4-9ae8-acca9f4bbcd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e42d9-9875-434c-ac60-3a81171e7b45]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:16 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:16 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:44:16 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:44:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:16 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:16 user nova-compute[75354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d (non-flash)
Nov 14 06:44:16 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:44:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074226ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ba7a69-993e-4cb7-863c-5b32837ad963]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37705654-858e-4225-a3d1-b660d41ca201]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be43c41-8337-4665-9801-7e45c912de86]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e26f66-d117-4805-ac75-86c13ecd74d6]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d8690-7877-4393-a241-7f5df7fb36da]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca62ff3-9300-43a5-938b-f11b640db68d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260]
Nov 14 06:44:16 user nova-compute[75354]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d, portal: 172.16.0.220,3260] successful.
Nov 14 06:44:16 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17cae8d-1ad6-422b-a8ef-ea204fcab955]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== disconnect_volume: return (365ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:44:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'flavor' on Instance uuid a7341396-5af8-4616-95d3-9cdb8c6e0a72 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dc3ae6b0-b34e-4336-99e4-6fded8c6c49e tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.666s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:17 user nova-compute[75354]: INFO nova.compute.manager [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Terminating instance
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-58532f0f-038f-4ea5-a8aa-eb5cd14fa168 req-9c10f213-308d-4227-b1ba-3bc10951f147 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-vif-unplugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-58532f0f-038f-4ea5-a8aa-eb5cd14fa168 req-9c10f213-308d-4227-b1ba-3bc10951f147 service nova] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-58532f0f-038f-4ea5-a8aa-eb5cd14fa168 req-9c10f213-308d-4227-b1ba-3bc10951f147 service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-58532f0f-038f-4ea5-a8aa-eb5cd14fa168 req-9c10f213-308d-4227-b1ba-3bc10951f147 service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-58532f0f-038f-4ea5-a8aa-eb5cd14fa168 req-9c10f213-308d-4227-b1ba-3bc10951f147 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] No waiting events found dispatching network-vif-unplugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-58532f0f-038f-4ea5-a8aa-eb5cd14fa168 req-9c10f213-308d-4227-b1ba-3bc10951f147 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-vif-unplugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Instance destroyed successfully.
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lazy-loading 'resources' on Instance uuid a7341396-5af8-4616-95d3-9cdb8c6e0a72 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-203241767',display_name='tempest-VolumesSnapshotTestJSON-instance-203241767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-203241767',id=27,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZndrGmte7hoIsV9BkZQ0xuy8n7Kjjo6jX/7Le91WB6OITJzgvUg1I+JSHV+vBAeLeIoLnvlzp9RGqi0I1AI1/b8Rf6gV6rBKZI8nlBtzOC+YpIipPZCBvqqBCf9DzrAA==',key_name='tempest-keypair-1233857804',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='081861be85ab4c6eae414a2f8b98fde4',ramdisk_id='',reservation_id='r-v63grsnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-518810154',owner_user_name='tempest-VolumesSnapshotTestJSON-518810154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1959e146b024fad873f92cf252aec6b',uuid=a7341396-5af8-4616-95d3-9cdb8c6e0a72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converting VIF {"id": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "address": "fa:16:3e:07:65:97", "network": {"id": "56527677-ceb0-4e1e-81cc-29fa4c294809", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692466468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "081861be85ab4c6eae414a2f8b98fde4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb217109c-5d", "ovs_interfaceid": "b217109c-5da7-4c36-a2e3-6949fb230bc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG os_vif [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb217109c-5d, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1edb02f-f213-4218-9dd5-21939465bcef) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:17 user nova-compute[75354]: INFO os_vif [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:65:97,bridge_name='br-int',has_traffic_filtering=True,id=b217109c-5da7-4c36-a2e3-6949fb230bc3,network=Network(56527677-ceb0-4e1e-81cc-29fa4c294809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb217109c-5d')
Nov 14 06:44:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvCitKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:44:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:44:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:44:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c15bfa-a536-4500-892f-3f0f4175e034]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:44:18 user nova-compute[75354]: No targets found.
Nov 14 06:44:18 user nova-compute[75354]: iSNS:
Nov 14 06:44:18 user nova-compute[75354]: No targets found.
Nov 14 06:44:18 user nova-compute[75354]: STATIC:
Nov 14 06:44:18 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5
Nov 14 06:44:18 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:18 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:18 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:44:18 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:18 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:18 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:44:18 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:44:18 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:44:18 user nova-compute[75354]: FIRMWARE:
Nov 14 06:44:18 user nova-compute[75354]: No targets found.
Nov 14 06:44:18 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:44:18 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:44:18 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e9f8f6-8218-4db9-88c8-c154356fec2d', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[52450160-9df2-48b6-96a4-94054ed90eca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4008611a-339a-479c-a424-8587223ba99d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:18 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:18 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:44:18 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:44:18 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:44:18 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:44:18 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074224430>, {}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Disconnecting from: [] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] <== disconnect_volume: return (81ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:44:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Deleting instance files /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72_del
Nov 14 06:44:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Deletion of /opt/stack/data/nova/instances/a7341396-5af8-4616-95d3-9cdb8c6e0a72_del complete
Nov 14 06:44:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:18 user nova-compute[75354]: INFO nova.compute.manager [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 06:44:18 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:18 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:44:18 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Took 0.77 seconds to deallocate network for instance.
Nov 14 06:44:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-d17f8269-a3b7-4228-8f63-0fad46a274ec req-0ee9b8ee-6b82-4eca-9bea-a579b20bdb21 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-vif-deleted-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:18 user nova-compute[75354]: WARNING nova.volume.cinder [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Attachment d4986f9a-e0dd-4aa4-b8cb-8875033c8c2a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d4986f9a-e0dd-4aa4-b8cb-8875033c8c2a. (HTTP 404) (Request-ID: req-cb935771-0d27-4aea-a9b7-66c664ad8060)
Nov 14 06:44:18 user nova-compute[75354]: INFO nova.compute.manager [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:19 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Deleted allocations for instance a7341396-5af8-4616-95d3-9cdb8c6e0a72
Nov 14 06:44:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-6d55c0e2-16ff-4067-8cb4-42d6004862a9 req-b241d1f5-8b54-4de8-9232-6ccba1a4cf61 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received event network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6d55c0e2-16ff-4067-8cb4-42d6004862a9 req-b241d1f5-8b54-4de8-9232-6ccba1a4cf61 service nova] Acquiring lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6d55c0e2-16ff-4067-8cb4-42d6004862a9 req-b241d1f5-8b54-4de8-9232-6ccba1a4cf61 service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6d55c0e2-16ff-4067-8cb4-42d6004862a9 req-b241d1f5-8b54-4de8-9232-6ccba1a4cf61 service nova] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-6d55c0e2-16ff-4067-8cb4-42d6004862a9 req-b241d1f5-8b54-4de8-9232-6ccba1a4cf61 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] No waiting events found dispatching network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:44:19 user nova-compute[75354]: WARNING nova.compute.manager [req-6d55c0e2-16ff-4067-8cb4-42d6004862a9 req-b241d1f5-8b54-4de8-9232-6ccba1a4cf61 service nova] [instance: a7341396-5af8-4616-95d3-9cdb8c6e0a72] Received unexpected event network-vif-plugged-b217109c-5da7-4c36-a2e3-6949fb230bc3 for instance with vm_state deleted and task_state None.
Nov 14 06:44:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b780c9b6-16fd-4359-8718-23f7fcd1c70d tempest-VolumesSnapshotTestJSON-518810154 tempest-VolumesSnapshotTestJSON-518810154-project-member] Lock "a7341396-5af8-4616-95d3-9cdb8c6e0a72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.442s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:44:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:38 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:44:38 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7944MB free_disk=25.197986602783203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:44:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:44:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updating instance_info_cache with network_info: [{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:44:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:44:47 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:44:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:44:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:45:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:45:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:45:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:23 user nova-compute[75354]: INFO nova.compute.manager [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Detaching volume 3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:45:23 user nova-compute[75354]: INFO nova.virt.block_device [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Attempting to driver detach volume 3b473b12-917d-4dcb-af0f-43252ffb2607 from mountpoint /dev/vdb
Nov 14 06:45:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Attempting to detach device vdb from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:45:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:45:23 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:45:23 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:45:23 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:45:23 user nova-compute[75354]:   <serial>3b473b12-917d-4dcb-af0f-43252ffb2607</serial>
Nov 14 06:45:23 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 06:45:23 user nova-compute[75354]: </disk>
Nov 14 06:45:23 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:45:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully detached device vdb from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 from the persistent domain config.
Nov 14 06:45:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:45:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:45:23 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:45:23 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:45:23 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:45:23 user nova-compute[75354]:   <serial>3b473b12-917d-4dcb-af0f-43252ffb2607</serial>
Nov 14 06:45:23 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 06:45:23 user nova-compute[75354]: </disk>
Nov 14 06:45:23 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:45:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:45:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:38 user nova-compute[75354]: INFO nova.compute.manager [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] instance snapshotting
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Beginning live snapshot process
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.195s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv4cfe5w3/fa309e3bac91400bbdb75fc1debbe59f.delta 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv4cfe5w3/fa309e3bac91400bbdb75fc1debbe59f.delta 1073741824" returned: 0 in 0.064s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:45:39 user nova-compute[75354]: INFO nova.compute.claims [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Claim successful on node user
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] COPY block job progress, current cursor: 3407872 final cursor: 75497472 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:45:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG nova.policy [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07a91eeb60a543098e888519aca9473a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea0f7807ec54c9aae976efd94654288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:45:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Creating image(s)
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "/opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "/opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "/opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:40 user nova-compute[75354]: INFO nova.compute.manager [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Unshelving
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 06:45:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'pci_requests' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv4cfe5w3/fa309e3bac91400bbdb75fc1debbe59f.delta /opt/stack/data/nova/instances/snapshots/tmpv4cfe5w3/fa309e3bac91400bbdb75fc1debbe59f {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'numa_topology' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:45:40 user nova-compute[75354]: INFO nova.compute.claims [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Claim successful on node user
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.597s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:45:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8103MB free_disk=25.186622619628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk 1073741824" returned: 0 in 0.094s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.696s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Successfully created port: 37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv4cfe5w3/fa309e3bac91400bbdb75fc1debbe59f.delta /opt/stack/data/nova/instances/snapshots/tmpv4cfe5w3/fa309e3bac91400bbdb75fc1debbe59f" returned: 0 in 0.813s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Snapshot extracted, beginning image upload
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.215s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Cannot resize image /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Ensure instance console log exists: /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.148s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.514s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:41 user nova-compute[75354]: INFO nova.network.neutron [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating port fa23886d-d71e-4a0c-8e95-631c6e6487c1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (639f2b20-6e4a-4044-8740-35d2f7c0a858): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:45:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Successfully updated port: 37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquired lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-changed-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Refreshing instance network info cache due to event network-changed-37631173-913d-4a25-991f-764ce7503b05. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] Acquiring lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating instance_info_cache with network_info: [{"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.manager [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing instance network info cache due to event network-changed-fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] Acquiring lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Releasing lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Instance network_info: |[{"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] Acquired lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Refreshing network info cache for port 37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Start _get_guest_xml network_info=[{"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:45:42 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:45:42 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:45:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-188955490',display_name='tempest-SnapshotDataIntegrityTests-server-188955490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-188955490',id=31,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2qDaFJs9gzTN5Yks2a6gnhysueyVbIu7Id72Fe/p1nSo/LgtuKett9fKjuLGYjP1VqDpDL9NNy4MSz2qllrssuLtrsj++7bcWKEO4jST0NcOkPrv2BwFimmU+KJ0nYgA==',key_name='tempest-keypair-1605347772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea0f7807ec54c9aae976efd94654288',ramdisk_id='',reservation_id='r-nkfvx160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2124672308',owner_user_name='tempest-SnapshotDataIntegrityTests-2124672308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07a91eeb60a543098e888519aca9473a',uuid=dde78cdf-442b-4f1b-bbfa-bd25ae232264,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Converting VIF {"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'pci_devices' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:45:42 user nova-compute[75354]:   <uuid>dde78cdf-442b-4f1b-bbfa-bd25ae232264</uuid>
Nov 14 06:45:42 user nova-compute[75354]:   <name>instance-0000001f</name>
Nov 14 06:45:42 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:45:42 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:45:42 user nova-compute[75354]:   <metadata>
Nov 14 06:45:42 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:45:42 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:45:42 user nova-compute[75354]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-188955490</nova:name>
Nov 14 06:45:42 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:45:42</nova:creationTime>
Nov 14 06:45:42 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:45:42 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:45:42 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:45:42 user nova-compute[75354]:       <nova:owner>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:user uuid="07a91eeb60a543098e888519aca9473a">tempest-SnapshotDataIntegrityTests-2124672308-project-member</nova:user>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:project uuid="eea0f7807ec54c9aae976efd94654288">tempest-SnapshotDataIntegrityTests-2124672308</nova:project>
Nov 14 06:45:42 user nova-compute[75354]:       </nova:owner>
Nov 14 06:45:42 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:45:42 user nova-compute[75354]:       <nova:ports>
Nov 14 06:45:42 user nova-compute[75354]:         <nova:port uuid="37631173-913d-4a25-991f-764ce7503b05">
Nov 14 06:45:42 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 06:45:42 user nova-compute[75354]:         </nova:port>
Nov 14 06:45:42 user nova-compute[75354]:       </nova:ports>
Nov 14 06:45:42 user nova-compute[75354]:     </nova:instance>
Nov 14 06:45:42 user nova-compute[75354]:   </metadata>
Nov 14 06:45:42 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:45:42 user nova-compute[75354]:     <system>
Nov 14 06:45:42 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:45:42 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:45:42 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:45:42 user nova-compute[75354]:       <entry name="serial">dde78cdf-442b-4f1b-bbfa-bd25ae232264</entry>
Nov 14 06:45:42 user nova-compute[75354]:       <entry name="uuid">dde78cdf-442b-4f1b-bbfa-bd25ae232264</entry>
Nov 14 06:45:42 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:45:42 user nova-compute[75354]:     </system>
Nov 14 06:45:42 user nova-compute[75354]:   </sysinfo>
Nov 14 06:45:42 user nova-compute[75354]:   <os>
Nov 14 06:45:42 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:45:42 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:45:42 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:45:42 user nova-compute[75354]:   </os>
Nov 14 06:45:42 user nova-compute[75354]:   <features>
Nov 14 06:45:42 user nova-compute[75354]:     <acpi/>
Nov 14 06:45:42 user nova-compute[75354]:     <apic/>
Nov 14 06:45:42 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:45:42 user nova-compute[75354]:   </features>
Nov 14 06:45:42 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:45:42 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:45:42 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:45:42 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:45:42 user nova-compute[75354]:   </clock>
Nov 14 06:45:42 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:45:42 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:45:42 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:45:42 user nova-compute[75354]:   </cpu>
Nov 14 06:45:42 user nova-compute[75354]:   <devices>
Nov 14 06:45:42 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:45:42 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:45:42 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk"/>
Nov 14 06:45:42 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:45:42 user nova-compute[75354]:     </disk>
Nov 14 06:45:42 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:45:42 user nova-compute[75354]:       <mac address="fa:16:3e:6e:f8:92"/>
Nov 14 06:45:42 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:45:42 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:45:42 user nova-compute[75354]:       <target dev="tap37631173-91"/>
Nov 14 06:45:42 user nova-compute[75354]:     </interface>
Nov 14 06:45:42 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:45:42 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/console.log" append="off"/>
Nov 14 06:45:42 user nova-compute[75354]:     </serial>
Nov 14 06:45:42 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:45:42 user nova-compute[75354]:     <video>
Nov 14 06:45:42 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:45:42 user nova-compute[75354]:     </video>
Nov 14 06:45:42 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:45:42 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:45:42 user nova-compute[75354]:     </rng>
Nov 14 06:45:42 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:45:42 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:45:42 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:45:42 user nova-compute[75354]:     </memballoon>
Nov 14 06:45:42 user nova-compute[75354]:   </devices>
Nov 14 06:45:42 user nova-compute[75354]: </domain>
Nov 14 06:45:42 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:45:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-188955490',display_name='tempest-SnapshotDataIntegrityTests-server-188955490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-188955490',id=31,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2qDaFJs9gzTN5Yks2a6gnhysueyVbIu7Id72Fe/p1nSo/LgtuKett9fKjuLGYjP1VqDpDL9NNy4MSz2qllrssuLtrsj++7bcWKEO4jST0NcOkPrv2BwFimmU+KJ0nYgA==',key_name='tempest-keypair-1605347772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea0f7807ec54c9aae976efd94654288',ramdisk_id='',reservation_id='r-nkfvx160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2124672308',owner_user_name='tempest-SnapshotDataIntegrityTests-2124672308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07a91eeb60a543098e888519aca9473a',uuid=dde78cdf-442b-4f1b-bbfa-bd25ae232264,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Converting VIF {"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG os_vif [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30f0c1db-e3ef-582e-a091-26b9c612767b', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37631173-91, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37631173-91, col_values=(('qos', UUID('ffd3f145-f9bf-4257-b4fc-63545e969995')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37631173-91, col_values=(('external_ids', {'iface-id': '37631173-913d-4a25-991f-764ce7503b05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:f8:92', 'vm-uuid': 'dde78cdf-442b-4f1b-bbfa-bd25ae232264'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:42 user nova-compute[75354]: INFO os_vif [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91')
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No VIF found with MAC fa:16:3e:6e:f8:92, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updated VIF entry in instance network info cache for port 37631173-913d-4a25-991f-764ce7503b05. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating instance_info_cache with network_info: [{"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68a1aba4-b883-4b13-99f9-b39bee123e5f req-092b0284-b2c4-449a-ae69-417802299c6e service nova] Releasing lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:45:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Creating image(s)
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'trusted_certs' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] Acquired lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.network.neutron [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Refreshing network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG nova.objects.base [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<a63ddb47-d6c2-48c2-9a43-a1a41583b3ca> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "def5a8126b49eeda1dcc24b613a9f73a4f1d0b10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "def5a8126b49eeda1dcc24b613a9f73a4f1d0b10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:44 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 is timed out.
Nov 14 06:45:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully detached device vdb from instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 from the live domain config.
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziLthgbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:45:44 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-25b84d24-2fab-40ad-a795-3b0ccdef46b5 req-4c5f8eba-17c9-4bcc-8d34-9aa6678b0e28 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-25b84d24-2fab-40ad-a795-3b0ccdef46b5 req-4c5f8eba-17c9-4bcc-8d34-9aa6678b0e28 service nova] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-25b84d24-2fab-40ad-a795-3b0ccdef46b5 req-4c5f8eba-17c9-4bcc-8d34-9aa6678b0e28 service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-25b84d24-2fab-40ad-a795-3b0ccdef46b5 req-4c5f8eba-17c9-4bcc-8d34-9aa6678b0e28 service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-25b84d24-2fab-40ad-a795-3b0ccdef46b5 req-4c5f8eba-17c9-4bcc-8d34-9aa6678b0e28 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] No waiting events found dispatching network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:45:44 user nova-compute[75354]: WARNING nova.compute.manager [req-25b84d24-2fab-40ad-a795-3b0ccdef46b5 req-4c5f8eba-17c9-4bcc-8d34-9aa6678b0e28 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received unexpected event network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 for instance with vm_state building and task_state spawning.
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.part --force-share --output=json" returned: 0 in 0.229s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.virt.images [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] 63bd70c5-a6c2-4503-a935-1a18edef675d was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.part /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[accf9ced-a165-4d47-a0de-69b6da0a34b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:45:44 user nova-compute[75354]: No targets found.
Nov 14 06:45:44 user nova-compute[75354]: iSNS:
Nov 14 06:45:44 user nova-compute[75354]: No targets found.
Nov 14 06:45:44 user nova-compute[75354]: STATIC:
Nov 14 06:45:44 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5
Nov 14 06:45:44 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:45:44 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:45:44 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607
Nov 14 06:45:44 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:45:44 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:45:44 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:45:44 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:45:44 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:45:44 user nova-compute[75354]: FIRMWARE:
Nov 14 06:45:44 user nova-compute[75354]: No targets found.
Nov 14 06:45:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:45:44 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:45:44 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee6c28-80bd-452c-b792-d222ba18e6c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ec9904-0d0a-4442-b673-9004a0abd905]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:45:44 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:45:44 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:45:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:45:44 user nova-compute[75354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 (non-flash)
Nov 14 06:45:44 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:45:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80989309d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62d5f7e-d64f-404a-877b-083b968ba6bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08017b1-3902-4871-8221-675c4d7871a4]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf7c62-9ef6-4544-b11a-38eda158e555]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updated VIF entry in instance network info cache for port fa23886d-d71e-4a0c-8e95-631c6e6487c1. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:45:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Snapshot image upload complete
Nov 14 06:45:44 user nova-compute[75354]: INFO nova.compute.manager [None req-d363eb25-7d0e-4df4-800f-df0e499be788 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Took 6.54 seconds to snapshot the instance on the hypervisor.
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a68b45-1237-41af-8fc5-d0c89e515873]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-21cbc5ba-0f8b-421d-b0ef-f77f16ddf4c2 req-ea56de18-ee42-418e-aef3-a553d4264d91 service nova] Releasing lock "refresh_cache-a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.part /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.converted" returned: 0 in 0.328s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b32eec-e585-4768-bff7-b80f0bb352bb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa7fbb4-1ce5-4d11-9fb6-a127ad66ef36]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260]
Nov 14 06:45:44 user nova-compute[75354]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607, portal: 172.16.0.220,3260] successful.
Nov 14 06:45:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b473b12-917d-4dcb-af0f-43252ffb2607 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28252bd9-7bbb-44e0-9f56-2c425294b121]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.513s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== disconnect_volume: return (515ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "def5a8126b49eeda1dcc24b613a9f73a4f1d0b10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.973s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "def5a8126b49eeda1dcc24b613a9f73a4f1d0b10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "def5a8126b49eeda1dcc24b613a9f73a4f1d0b10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10,backing_fmt=raw /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10,backing_fmt=raw /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk 1073741824" returned: 0 in 0.055s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "def5a8126b49eeda1dcc24b613a9f73a4f1d0b10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'migration_context' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG nova.objects.base [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<a63ddb47-d6c2-48c2-9a43-a1a41583b3ca> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:45:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Rebasing disk image.
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'flavor' on Instance uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-17b537e3-990b-4ca9-9281-36f31fe0b9f4 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.947s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 -F raw /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:45:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Instance spawned successfully.
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-6e73b726-268f-4f5b-8e46-206719bbf2f5 req-0759816d-a72f-4fad-88bb-a3d661f70a86 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6e73b726-268f-4f5b-8e46-206719bbf2f5 req-0759816d-a72f-4fad-88bb-a3d661f70a86 service nova] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6e73b726-268f-4f5b-8e46-206719bbf2f5 req-0759816d-a72f-4fad-88bb-a3d661f70a86 service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6e73b726-268f-4f5b-8e46-206719bbf2f5 req-0759816d-a72f-4fad-88bb-a3d661f70a86 service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-6e73b726-268f-4f5b-8e46-206719bbf2f5 req-0759816d-a72f-4fad-88bb-a3d661f70a86 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] No waiting events found dispatching network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:45:46 user nova-compute[75354]: WARNING nova.compute.manager [req-6e73b726-268f-4f5b-8e46-206719bbf2f5 req-0759816d-a72f-4fad-88bb-a3d661f70a86 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received unexpected event network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 for instance with vm_state building and task_state spawning.
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:45:46 user nova-compute[75354]: INFO nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:45:46 user nova-compute[75354]: INFO nova.compute.manager [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Took 7.41 seconds to build instance.
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fa0d46a4-69f3-4188-b94c-e7c4dac08885 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.516s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 -F raw /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk" returned: 0 in 2.065s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Start _get_guest_xml network_info=[{"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d318ab6c83d4fce11922c4f70b091049',container_format='bare',created_at=2023-11-14T06:43:47Z,direct_url=<?>,disk_format='qcow2',id=63bd70c5-a6c2-4503-a935-1a18edef675d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-904050191-shelved',owner='00f5ecd6fc1944b583d57d14e2a0559e',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T06:43:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:45:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:45:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d318ab6c83d4fce11922c4f70b091049',container_format='bare',created_at=2023-11-14T06:43:47Z,direct_url=<?>,disk_format='qcow2',id=63bd70c5-a6c2-4503-a935-1a18edef675d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-904050191-shelved',owner='00f5ecd6fc1944b583d57d14e2a0559e',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T06:43:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'vcpu_model' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.objects.base [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<a63ddb47-d6c2-48c2-9a43-a1a41583b3ca> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904050191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904050191',id=28,image_ref='63bd70c5-a6c2-4503-a935-1a18edef675d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1737925936',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-p90j785d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member',shelved_at='2023-11-14T06:43:51.852911',shelved_host='user',shelved_image_id='63bd70c5-a6c2-4503-a935-1a18edef675d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=a63ddb47-d6c2-48c2-9a43-a1a41583b3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'pci_devices' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.objects.base [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Object Instance<a63ddb47-d6c2-48c2-9a43-a1a41583b3ca> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:45:47 user nova-compute[75354]:   <uuid>a63ddb47-d6c2-48c2-9a43-a1a41583b3ca</uuid>
Nov 14 06:45:47 user nova-compute[75354]:   <name>instance-0000001c</name>
Nov 14 06:45:47 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:45:47 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:45:47 user nova-compute[75354]:   <metadata>
Nov 14 06:45:47 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:45:47 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:45:47 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-904050191</nova:name>
Nov 14 06:45:47 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:45:47</nova:creationTime>
Nov 14 06:45:47 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:45:47 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:45:47 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:45:47 user nova-compute[75354]:       <nova:owner>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:user uuid="70d7d1261dfa452cacd628da418f7783">tempest-AttachVolumeShelveTestJSON-443282580-project-member</nova:user>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:project uuid="00f5ecd6fc1944b583d57d14e2a0559e">tempest-AttachVolumeShelveTestJSON-443282580</nova:project>
Nov 14 06:45:47 user nova-compute[75354]:       </nova:owner>
Nov 14 06:45:47 user nova-compute[75354]:       <nova:root type="image" uuid="63bd70c5-a6c2-4503-a935-1a18edef675d"/>
Nov 14 06:45:47 user nova-compute[75354]:       <nova:ports>
Nov 14 06:45:47 user nova-compute[75354]:         <nova:port uuid="fa23886d-d71e-4a0c-8e95-631c6e6487c1">
Nov 14 06:45:47 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 06:45:47 user nova-compute[75354]:         </nova:port>
Nov 14 06:45:47 user nova-compute[75354]:       </nova:ports>
Nov 14 06:45:47 user nova-compute[75354]:     </nova:instance>
Nov 14 06:45:47 user nova-compute[75354]:   </metadata>
Nov 14 06:45:47 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:45:47 user nova-compute[75354]:     <system>
Nov 14 06:45:47 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:45:47 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:45:47 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:45:47 user nova-compute[75354]:       <entry name="serial">a63ddb47-d6c2-48c2-9a43-a1a41583b3ca</entry>
Nov 14 06:45:47 user nova-compute[75354]:       <entry name="uuid">a63ddb47-d6c2-48c2-9a43-a1a41583b3ca</entry>
Nov 14 06:45:47 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:45:47 user nova-compute[75354]:     </system>
Nov 14 06:45:47 user nova-compute[75354]:   </sysinfo>
Nov 14 06:45:47 user nova-compute[75354]:   <os>
Nov 14 06:45:47 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:45:47 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:45:47 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:45:47 user nova-compute[75354]:   </os>
Nov 14 06:45:47 user nova-compute[75354]:   <features>
Nov 14 06:45:47 user nova-compute[75354]:     <acpi/>
Nov 14 06:45:47 user nova-compute[75354]:     <apic/>
Nov 14 06:45:47 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:45:47 user nova-compute[75354]:   </features>
Nov 14 06:45:47 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:45:47 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:45:47 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:45:47 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:45:47 user nova-compute[75354]:   </clock>
Nov 14 06:45:47 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:45:47 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:45:47 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:45:47 user nova-compute[75354]:   </cpu>
Nov 14 06:45:47 user nova-compute[75354]:   <devices>
Nov 14 06:45:47 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:45:47 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:45:47 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk"/>
Nov 14 06:45:47 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:45:47 user nova-compute[75354]:     </disk>
Nov 14 06:45:47 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:45:47 user nova-compute[75354]:       <mac address="fa:16:3e:c9:fc:29"/>
Nov 14 06:45:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:45:47 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:45:47 user nova-compute[75354]:       <target dev="tapfa23886d-d7"/>
Nov 14 06:45:47 user nova-compute[75354]:     </interface>
Nov 14 06:45:47 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:45:47 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/console.log" append="off"/>
Nov 14 06:45:47 user nova-compute[75354]:     </serial>
Nov 14 06:45:47 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:45:47 user nova-compute[75354]:     <video>
Nov 14 06:45:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:45:47 user nova-compute[75354]:     </video>
Nov 14 06:45:47 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:45:47 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:45:47 user nova-compute[75354]:     </rng>
Nov 14 06:45:47 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:45:47 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:45:47 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:45:47 user nova-compute[75354]:     </memballoon>
Nov 14 06:45:47 user nova-compute[75354]:   </devices>
Nov 14 06:45:47 user nova-compute[75354]: </domain>
Nov 14 06:45:47 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904050191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904050191',id=28,image_ref='63bd70c5-a6c2-4503-a935-1a18edef675d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1737925936',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-p90j785d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member',shelved_at='2023-11-14T06:43:51.852911',shelved_host='user',shelved_image_id='63bd70c5-a6c2-4503-a935-1a18edef675d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=a63ddb47-d6c2-48c2-9a43-a1a41583b3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG os_vif [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97ccbce7-0a25-53a1-8df9-0339eee83944', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa23886d-d7, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa23886d-d7, col_values=(('qos', UUID('dbd96a58-aecc-4dfd-a52e-c5d2cdd17427')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa23886d-d7, col_values=(('external_ids', {'iface-id': 'fa23886d-d71e-4a0c-8e95-631c6e6487c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:fc:29', 'vm-uuid': 'a63ddb47-d6c2-48c2-9a43-a1a41583b3ca'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:47 user nova-compute[75354]: INFO os_vif [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7')
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:45:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] No VIF found with MAC fa:16:3e:c9:fc:29, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:45:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-476caa79-fc07-41bf-97a8-daedb711dd2d req-2e80be66-ff4c-43a4-b2aa-41d4f28b889f service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-476caa79-fc07-41bf-97a8-daedb711dd2d req-2e80be66-ff4c-43a4-b2aa-41d4f28b889f service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-476caa79-fc07-41bf-97a8-daedb711dd2d req-2e80be66-ff4c-43a4-b2aa-41d4f28b889f service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-476caa79-fc07-41bf-97a8-daedb711dd2d req-2e80be66-ff4c-43a4-b2aa-41d4f28b889f service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-476caa79-fc07-41bf-97a8-daedb711dd2d req-2e80be66-ff4c-43a4-b2aa-41d4f28b889f service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:45:49 user nova-compute[75354]: WARNING nova.compute.manager [req-476caa79-fc07-41bf-97a8-daedb711dd2d req-2e80be66-ff4c-43a4-b2aa-41d4f28b889f service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 06:45:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:45:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance spawned successfully.
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-5d6aca51-4e6a-4fb4-9eef-029440ff6993 req-8814df1c-a393-478c-99d2-cde420661bbf service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5d6aca51-4e6a-4fb4-9eef-029440ff6993 req-8814df1c-a393-478c-99d2-cde420661bbf service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5d6aca51-4e6a-4fb4-9eef-029440ff6993 req-8814df1c-a393-478c-99d2-cde420661bbf service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5d6aca51-4e6a-4fb4-9eef-029440ff6993 req-8814df1c-a393-478c-99d2-cde420661bbf service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-5d6aca51-4e6a-4fb4-9eef-029440ff6993 req-8814df1c-a393-478c-99d2-cde420661bbf service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:45:51 user nova-compute[75354]: WARNING nova.compute.manager [req-5d6aca51-4e6a-4fb4-9eef-029440ff6993 req-8814df1c-a393-478c-99d2-cde420661bbf service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 06:45:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:45:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ad0bd654-6d81-43a1-b92c-65cebbbfd5a6 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.625s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:45:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:45:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:45:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:01 user nova-compute[75354]: INFO nova.compute.manager [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Unrescuing
Nov 14 06:46:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'flavor' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-f7e1f59c-17af-4b87-bed7-9b41fc030171 req-3d572ce9-1dab-49b3-87e8-7d2757867080 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f7e1f59c-17af-4b87-bed7-9b41fc030171 req-3d572ce9-1dab-49b3-87e8-7d2757867080 service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f7e1f59c-17af-4b87-bed7-9b41fc030171 req-3d572ce9-1dab-49b3-87e8-7d2757867080 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f7e1f59c-17af-4b87-bed7-9b41fc030171 req-3d572ce9-1dab-49b3-87e8-7d2757867080 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-f7e1f59c-17af-4b87-bed7-9b41fc030171 req-3d572ce9-1dab-49b3-87e8-7d2757867080 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:46:01 user nova-compute[75354]: WARNING nova.compute.manager [req-f7e1f59c-17af-4b87-bed7-9b41fc030171 req-3d572ce9-1dab-49b3-87e8-7d2757867080 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:46:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance destroyed successfully.
Nov 14 06:46:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:46:03 user nova-compute[75354]: WARNING nova.compute.manager [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:46:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:46:03 user nova-compute[75354]: WARNING nova.compute.manager [req-526d10b7-8fd1-4db0-b15e-8f4556109cc3 req-075674e7-ae8c-4742-8faa-5674a8beff32 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-a072f604-0d18-4d0a-bd88-6559b44957f1 req-bb8c80a1-ada7-4439-b72a-c2776cf382d2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a072f604-0d18-4d0a-bd88-6559b44957f1 req-bb8c80a1-ada7-4439-b72a-c2776cf382d2 service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a072f604-0d18-4d0a-bd88-6559b44957f1 req-bb8c80a1-ada7-4439-b72a-c2776cf382d2 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a072f604-0d18-4d0a-bd88-6559b44957f1 req-bb8c80a1-ada7-4439-b72a-c2776cf382d2 service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-a072f604-0d18-4d0a-bd88-6559b44957f1 req-bb8c80a1-ada7-4439-b72a-c2776cf382d2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:46:05 user nova-compute[75354]: WARNING nova.compute.manager [req-a072f604-0d18-4d0a-bd88-6559b44957f1 req-bb8c80a1-ada7-4439-b72a-c2776cf382d2 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:46:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ff3e37c5-1b1d-4520-9b77-47c57ef8c927 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:46:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:14 user nova-compute[75354]: INFO nova.compute.manager [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Terminating instance
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-acda2646-23a8-42ec-8445-38dd2adf60ce req-77728151-1018-426f-a14e-ec693fc6dafe service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-unplugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acda2646-23a8-42ec-8445-38dd2adf60ce req-77728151-1018-426f-a14e-ec693fc6dafe service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acda2646-23a8-42ec-8445-38dd2adf60ce req-77728151-1018-426f-a14e-ec693fc6dafe service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acda2646-23a8-42ec-8445-38dd2adf60ce req-77728151-1018-426f-a14e-ec693fc6dafe service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-acda2646-23a8-42ec-8445-38dd2adf60ce req-77728151-1018-426f-a14e-ec693fc6dafe service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-unplugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-acda2646-23a8-42ec-8445-38dd2adf60ce req-77728151-1018-426f-a14e-ec693fc6dafe service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-unplugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Instance destroyed successfully.
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.objects.instance [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'resources' on Instance uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1145897967',display_name='tempest-ServerActionsTestOtherA-server-972822708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1145897967',id=25,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPbmueRvQCp8NqHkCrl+yrPwaxMxP5J2NT2Vaf31oFT1IvlI4SpRwbDbYwalpjGLQ42o8e/fTVcgQdeljAR+QqIS0S6/rg56+UP5l+gTokPzLjG1IO6wP/2PyM7b0XJmw==',key_name='tempest-keypair-1203834143',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-cerjhtt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=240cd94c-cfe6-47a0-a57e-90fd1266c7b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "address": "fa:16:3e:b4:90:8b", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86aea79-d2", "ovs_interfaceid": "b86aea79-d2dd-4944-8e2e-23b4a28fead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG os_vif [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb86aea79-d2, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2727332c-e45e-4d5a-a8ef-64763bcb36de) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:46:14 user nova-compute[75354]: INFO os_vif [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=b86aea79-d2dd-4944-8e2e-23b4a28fead6,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86aea79-d2')
Nov 14 06:46:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Deleting instance files /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5_del
Nov 14 06:46:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Deletion of /opt/stack/data/nova/instances/240cd94c-cfe6-47a0-a57e-90fd1266c7b5_del complete
Nov 14 06:46:15 user nova-compute[75354]: INFO nova.compute.manager [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:15 user nova-compute[75354]: WARNING nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 2b2f22af-1a41-4747-9a16-561e260d5f63 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 3e182ade-8d18-4fd0-a197-e4ea6d655e2d {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:46:15 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Took 0.79 seconds to deallocate network for instance.
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-f72c259a-ebff-4ee2-a717-dbdd511c1ec3 req-02c114df-51e1-4632-87f0-807ed9644d20 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-deleted-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:15 user nova-compute[75354]: INFO nova.compute.manager [req-f72c259a-ebff-4ee2-a717-dbdd511c1ec3 req-02c114df-51e1-4632-87f0-807ed9644d20 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Neutron deleted interface b86aea79-d2dd-4944-8e2e-23b4a28fead6; detaching it from the instance and deleting it from the info cache
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-f72c259a-ebff-4ee2-a717-dbdd511c1ec3 req-02c114df-51e1-4632-87f0-807ed9644d20 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-f72c259a-ebff-4ee2-a717-dbdd511c1ec3 req-02c114df-51e1-4632-87f0-807ed9644d20 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Detach interface failed, port_id=b86aea79-d2dd-4944-8e2e-23b4a28fead6, reason: Instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:16 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Deleted allocations for instance 240cd94c-cfe6-47a0-a57e-90fd1266c7b5
Nov 14 06:46:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-d1057102-aec9-4a37-a036-01dae1f11774 req-d9f02dba-20ff-4cce-a829-3d6fdd58cd85 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d1057102-aec9-4a37-a036-01dae1f11774 req-d9f02dba-20ff-4cce-a829-3d6fdd58cd85 service nova] Acquiring lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d1057102-aec9-4a37-a036-01dae1f11774 req-d9f02dba-20ff-4cce-a829-3d6fdd58cd85 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d1057102-aec9-4a37-a036-01dae1f11774 req-d9f02dba-20ff-4cce-a829-3d6fdd58cd85 service nova] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-d1057102-aec9-4a37-a036-01dae1f11774 req-d9f02dba-20ff-4cce-a829-3d6fdd58cd85 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] No waiting events found dispatching network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:46:16 user nova-compute[75354]: WARNING nova.compute.manager [req-d1057102-aec9-4a37-a036-01dae1f11774 req-d9f02dba-20ff-4cce-a829-3d6fdd58cd85 service nova] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] Received unexpected event network-vif-plugged-b86aea79-d2dd-4944-8e2e-23b4a28fead6 for instance with vm_state deleted and task_state None.
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0e7d331e-b71c-44ab-bd22-a4532954bfef tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.885s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:16 user nova-compute[75354]: INFO nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 240cd94c-cfe6-47a0-a57e-90fd1266c7b5] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 14 06:46:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "240cd94c-cfe6-47a0-a57e-90fd1266c7b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:40 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:46:40 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=25.109241485595703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a63ddb47-d6c2-48c2-9a43-a1a41583b3ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 06:46:40 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 06:46:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:46:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:46:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:46:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.934s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:46:46 user nova-compute[75354]: INFO nova.compute.claims [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Claim successful on node user
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:46:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:46:47 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:46:47 user nova-compute[75354]: INFO nova.virt.block_device [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Booting with volume-backed-image 013c3665-3f76-488b-92b6-f08787e9badf at /dev/vda
Nov 14 06:46:47 user nova-compute[75354]: DEBUG nova.policy [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfc31b05a2848128a837f170ac63b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0fdd525e8a49aeac22892962d8b14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Successfully created port: 594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Successfully updated port: 594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-changed-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Refreshing instance network info cache due to event network-changed-594b7395-73d6-438d-b330-426c12f00771. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] Acquiring lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:46:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updating instance_info_cache with network_info: [{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance network_info: |[{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] Acquired lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Refreshing network info cache for port 594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updated VIF entry in instance network info cache for port 594b7395-73d6-438d-b330-426c12f00771. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updating instance_info_cache with network_info: [{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:46:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ae66b9e-d60e-47c4-bd4c-bd18231e917d req-cd8096fc-bf5a-4962-854e-0c882882a9d5 service nova] Releasing lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:46:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG os_brick.utils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e0221-1495-454e-a32e-9931ba5eb086]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[100926d8-c51e-44cb-a869-9b62e8208422]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91e1fc3-f69f-47aa-8a56-113a96ca04fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613b9c3-7e2f-4610-9127-8664adb39e1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:46:53 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:46:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4010c6b-6b66-4fe2-9390-bde6c27555bf]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG os_brick.utils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:46:53 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updating existing volume attachment record: aea11505-6dc4-41a2-82a3-e92c24f08844 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:46:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:46:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:46:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Creating image(s)
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Ensure instance console log exists: /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Start _get_guest_xml network_info=[{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a833f57-2ff5-481e-9bf3-6f845343bb20', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'serial': 'bb0ef3b1-2048-4756-82d1-cb4c54e8c959'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'aea11505-6dc4-41a2-82a3-e92c24f08844', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:46:57 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:46:57 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:46:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:46:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:46:57 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[99035a0b-1069-4763-acb4-f50b3b836a5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:46:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f98ff5-3fdf-4cae-b2e1-65fd4cc9ea2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959] added
Nov 14 06:46:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caf2890-410b-439f-9c5c-291c10086fec]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe37de-992d-4a91-b3f8-4bf0dcb4000c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swZORKiC {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swZORKiC" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83949d1-735b-43ce-aea9-361df9f4d5bf]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'swZORKiC'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac276a-2126-4885-bbd0-989c39b9944f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc33d20f-c6f1-451d-a538-0ac1f1e8151b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8e95bf-ac4b-430c-8565-e2313d30baa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260]
Nov 14 06:46:57 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260] successful.
Nov 14 06:46:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4895bf4c-c9bf-472c-9b6e-fa8f65171cbc]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b8d32-af9f-47d0-b1c7-29515ad5d3a8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:46:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75658e07-22f1-443d-9701-eedee3bca928]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:46:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23731633663363436', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633663363436', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278141768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278141768',id=32,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-oglr9pef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:46:47Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=8a833f57-2ff5-481e-9bf3-6f845343bb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:46:58 user nova-compute[75354]:   <uuid>8a833f57-2ff5-481e-9bf3-6f845343bb20</uuid>
Nov 14 06:46:58 user nova-compute[75354]:   <name>instance-00000020</name>
Nov 14 06:46:58 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:46:58 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:46:58 user nova-compute[75354]:   <metadata>
Nov 14 06:46:58 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:46:58 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:46:58 user nova-compute[75354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-278141768</nova:name>
Nov 14 06:46:58 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:46:57</nova:creationTime>
Nov 14 06:46:58 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:46:58 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:46:58 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:46:58 user nova-compute[75354]:       <nova:owner>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:user uuid="2dfc31b05a2848128a837f170ac63b93">tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member</nova:user>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:project uuid="7e0fdd525e8a49aeac22892962d8b14e">tempest-ServerBootFromVolumeStableRescueTest-1883221150</nova:project>
Nov 14 06:46:58 user nova-compute[75354]:       </nova:owner>
Nov 14 06:46:58 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:46:58 user nova-compute[75354]:       <nova:ports>
Nov 14 06:46:58 user nova-compute[75354]:         <nova:port uuid="594b7395-73d6-438d-b330-426c12f00771">
Nov 14 06:46:58 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 06:46:58 user nova-compute[75354]:         </nova:port>
Nov 14 06:46:58 user nova-compute[75354]:       </nova:ports>
Nov 14 06:46:58 user nova-compute[75354]:     </nova:instance>
Nov 14 06:46:58 user nova-compute[75354]:   </metadata>
Nov 14 06:46:58 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:46:58 user nova-compute[75354]:     <system>
Nov 14 06:46:58 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:46:58 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:46:58 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:46:58 user nova-compute[75354]:       <entry name="serial">8a833f57-2ff5-481e-9bf3-6f845343bb20</entry>
Nov 14 06:46:58 user nova-compute[75354]:       <entry name="uuid">8a833f57-2ff5-481e-9bf3-6f845343bb20</entry>
Nov 14 06:46:58 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:46:58 user nova-compute[75354]:     </system>
Nov 14 06:46:58 user nova-compute[75354]:   </sysinfo>
Nov 14 06:46:58 user nova-compute[75354]:   <os>
Nov 14 06:46:58 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:46:58 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:46:58 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:46:58 user nova-compute[75354]:   </os>
Nov 14 06:46:58 user nova-compute[75354]:   <features>
Nov 14 06:46:58 user nova-compute[75354]:     <acpi/>
Nov 14 06:46:58 user nova-compute[75354]:     <apic/>
Nov 14 06:46:58 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:46:58 user nova-compute[75354]:   </features>
Nov 14 06:46:58 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:46:58 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:46:58 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:46:58 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:46:58 user nova-compute[75354]:   </clock>
Nov 14 06:46:58 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:46:58 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:46:58 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:46:58 user nova-compute[75354]:   </cpu>
Nov 14 06:46:58 user nova-compute[75354]:   <devices>
Nov 14 06:46:58 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:46:58 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:46:58 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 06:46:58 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:46:58 user nova-compute[75354]:       <serial>bb0ef3b1-2048-4756-82d1-cb4c54e8c959</serial>
Nov 14 06:46:58 user nova-compute[75354]:     </disk>
Nov 14 06:46:58 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:46:58 user nova-compute[75354]:       <mac address="fa:16:3e:3a:2c:72"/>
Nov 14 06:46:58 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:46:58 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:46:58 user nova-compute[75354]:       <target dev="tap594b7395-73"/>
Nov 14 06:46:58 user nova-compute[75354]:     </interface>
Nov 14 06:46:58 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:46:58 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/console.log" append="off"/>
Nov 14 06:46:58 user nova-compute[75354]:     </serial>
Nov 14 06:46:58 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:46:58 user nova-compute[75354]:     <video>
Nov 14 06:46:58 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:46:58 user nova-compute[75354]:     </video>
Nov 14 06:46:58 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:46:58 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:46:58 user nova-compute[75354]:     </rng>
Nov 14 06:46:58 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:46:58 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:46:58 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:46:58 user nova-compute[75354]:     </memballoon>
Nov 14 06:46:58 user nova-compute[75354]:   </devices>
Nov 14 06:46:58 user nova-compute[75354]: </domain>
Nov 14 06:46:58 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278141768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278141768',id=32,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-oglr9pef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:46:47Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=8a833f57-2ff5-481e-9bf3-6f845343bb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG os_vif [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80bf92ff-6f61-5511-8fa0-4df008145a64', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap594b7395-73, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap594b7395-73, col_values=(('qos', UUID('b769dde8-d859-41a3-939b-ee4d2419e762')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap594b7395-73, col_values=(('external_ids', {'iface-id': '594b7395-73d6-438d-b330-426c12f00771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:2c:72', 'vm-uuid': '8a833f57-2ff5-481e-9bf3-6f845343bb20'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:46:58 user nova-compute[75354]: INFO os_vif [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73')
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:46:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No VIF found with MAC fa:16:3e:3a:2c:72, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-63d3f580-342e-4ee6-bb60-59206b8412f2 req-da42ce19-64ba-4471-8b0f-eb6ea453e59b service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63d3f580-342e-4ee6-bb60-59206b8412f2 req-da42ce19-64ba-4471-8b0f-eb6ea453e59b service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63d3f580-342e-4ee6-bb60-59206b8412f2 req-da42ce19-64ba-4471-8b0f-eb6ea453e59b service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-63d3f580-342e-4ee6-bb60-59206b8412f2 req-da42ce19-64ba-4471-8b0f-eb6ea453e59b service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-63d3f580-342e-4ee6-bb60-59206b8412f2 req-da42ce19-64ba-4471-8b0f-eb6ea453e59b service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:47:00 user nova-compute[75354]: WARNING nova.compute.manager [req-63d3f580-342e-4ee6-bb60-59206b8412f2 req-da42ce19-64ba-4471-8b0f-eb6ea453e59b service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state building and task_state spawning.
Nov 14 06:47:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:47:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance spawned successfully.
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:47:02 user nova-compute[75354]: INFO nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-e82e0f7e-542d-416e-8779-e84176295ff8 req-37ff57ca-16bb-45d8-93f2-b77fe35e5a64 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e82e0f7e-542d-416e-8779-e84176295ff8 req-37ff57ca-16bb-45d8-93f2-b77fe35e5a64 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e82e0f7e-542d-416e-8779-e84176295ff8 req-37ff57ca-16bb-45d8-93f2-b77fe35e5a64 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e82e0f7e-542d-416e-8779-e84176295ff8 req-37ff57ca-16bb-45d8-93f2-b77fe35e5a64 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-e82e0f7e-542d-416e-8779-e84176295ff8 req-37ff57ca-16bb-45d8-93f2-b77fe35e5a64 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:47:02 user nova-compute[75354]: WARNING nova.compute.manager [req-e82e0f7e-542d-416e-8779-e84176295ff8 req-37ff57ca-16bb-45d8-93f2-b77fe35e5a64 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state building and task_state spawning.
Nov 14 06:47:02 user nova-compute[75354]: INFO nova.compute.manager [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Took 15.71 seconds to build instance.
Nov 14 06:47:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6af1184-0614-4d1c-a670-05783c1681f0 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.802s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:47:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:47:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:47:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:47:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-changed-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Refreshing instance network info cache due to event network-changed-37631173-913d-4a25-991f-764ce7503b05. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:47:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] Acquiring lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:47:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] Acquired lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:47:29 user nova-compute[75354]: DEBUG nova.network.neutron [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Refreshing network info cache for port 37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:30 user nova-compute[75354]: INFO nova.compute.manager [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Terminating instance
Nov 14 06:47:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updated VIF entry in instance network info cache for port 37631173-913d-4a25-991f-764ce7503b05. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating instance_info_cache with network_info: [{"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f83a83f4-5948-449f-be9c-72fadc075030 req-bcd8b88c-8cc7-471b-a489-55da2cfd1fd3 service nova] Releasing lock "refresh_cache-dde78cdf-442b-4f1b-bbfa-bd25ae232264" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:47:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Instance destroyed successfully.
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lazy-loading 'resources' on Instance uuid a63ddb47-d6c2-48c2-9a43-a1a41583b3ca {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T06:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904050191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904050191',id=28,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1A3A9BcukZawHUjUEds9uc2Hcqr3jc5IY1p1IsXGtKSxB2rzUy15LsDIcKRGb/seUMdkbYxF0qk5yDP2v6y27ASZXAnCQbMDyzSdmof3YH+PONl7tETrcpVZBF2t6G0g==',key_name='tempest-keypair-1737925936',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:45:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00f5ecd6fc1944b583d57d14e2a0559e',ramdisk_id='',reservation_id='r-p90j785d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-443282580',owner_user_name='tempest-AttachVolumeShelveTestJSON-443282580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70d7d1261dfa452cacd628da418f7783',uuid=a63ddb47-d6c2-48c2-9a43-a1a41583b3ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converting VIF {"id": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "address": "fa:16:3e:c9:fc:29", "network": {"id": "281f11db-42eb-4149-bf74-515b74d27ffd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1746282378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f5ecd6fc1944b583d57d14e2a0559e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa23886d-d7", "ovs_interfaceid": "fa23886d-d71e-4a0c-8e95-631c6e6487c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG os_vif [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa23886d-d7, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbd96a58-aecc-4dfd-a52e-c5d2cdd17427) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:31 user nova-compute[75354]: INFO os_vif [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:29,bridge_name='br-int',has_traffic_filtering=True,id=fa23886d-d71e-4a0c-8e95-631c6e6487c1,network=Network(281f11db-42eb-4149-bf74-515b74d27ffd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa23886d-d7')
Nov 14 06:47:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Deleting instance files /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca_del
Nov 14 06:47:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Deletion of /opt/stack/data/nova/instances/a63ddb47-d6c2-48c2-9a43-a1a41583b3ca_del complete
Nov 14 06:47:31 user nova-compute[75354]: INFO nova.compute.manager [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-unplugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-unplugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-unplugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] Acquiring lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] No waiting events found dispatching network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:47:31 user nova-compute[75354]: WARNING nova.compute.manager [req-b35575c1-284d-4f81-95ea-7a2a0305e822 req-39cb5d51-f1d8-4184-8e41-e0cebc38e011 service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received unexpected event network-vif-plugged-fa23886d-d71e-4a0c-8e95-631c6e6487c1 for instance with vm_state active and task_state deleting.
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:47:31 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Took 0.80 seconds to deallocate network for instance.
Nov 14 06:47:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-c69fbe54-efe1-4bff-884c-90d2b705848e req-6a88809a-b4b3-4fca-b6eb-fd59c7cdd2ed service nova] [instance: a63ddb47-d6c2-48c2-9a43-a1a41583b3ca] Received event network-vif-deleted-fa23886d-d71e-4a0c-8e95-631c6e6487c1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:47:32 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Deleted allocations for instance a63ddb47-d6c2-48c2-9a43-a1a41583b3ca
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-dd8e5ff8-b0de-4d5a-8d76-463899419d49 tempest-AttachVolumeShelveTestJSON-443282580 tempest-AttachVolumeShelveTestJSON-443282580-project-member] Lock "a63ddb47-d6c2-48c2-9a43-a1a41583b3ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:32 user nova-compute[75354]: INFO nova.compute.manager [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attaching volume eae28cb8-6641-49ed-80e5-9bfc7e4a993e to /dev/vdb
Nov 14 06:47:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c650760f-5aa9-4e2a-b429-22fdc1b04c53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d3f695-bd6f-42fe-85d3-2d2770b27619]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba7ca40-29d4-42fc-a5fd-ae7a71971a38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e10a69-2ec0-4ffd-a6d5-49173c447587]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:47:32 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:47:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f687865a-eb66-4f42-8190-5c5f9e1df02f]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:47:32 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating existing volume attachment record: 84d54f60-b7c5-4515-86d0-783e2abf5581 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:47:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwgplOvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:47:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:47:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:47:36 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[511a317f-279b-470c-af26-451abaa35646]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:47:36 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c938513-6111-4ed1-9ce2-e569ac44778f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e] added
Nov 14 06:47:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce5dc30-343e-4aff-a7fc-6d3281b98fa6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2261d-4ca5-4787-9459-5ed597ff7556]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwgplOvd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwgplOvd" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768b7c3-e3d0-407f-9e2f-59c014f3fd6e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwgplOvd'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc323f-0eb9-4331-ba32-c18c8cb6f173]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceeab72-4044-4ab5-b69f-1f5d84acf0be]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c366a3-4e33-45e9-be9c-e59840a4e5c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260]
Nov 14 06:47:37 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260] successful.
Nov 14 06:47:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0938bd-705b-4f68-83c0-608e81469e99]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5423e730-5c7c-4866-9337-43f1f3ab67c6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e (non-flash)
Nov 14 06:47:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:47:37 user nova-compute[75354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e (non-flash)
Nov 14 06:47:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddb75f1-b5be-406d-9bc2-56012cd1dc5e]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwgplOvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23134396338363263', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134396338363263', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:47:38 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:47:38 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:47:38 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:47:38 user nova-compute[75354]:   <serial>eae28cb8-6641-49ed-80e5-9bfc7e4a993e</serial>
Nov 14 06:47:38 user nova-compute[75354]: </disk>
Nov 14 06:47:38 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No VIF found with MAC fa:16:3e:6e:f8:92, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e1db763f-b6c4-4f44-b14a-e2d49397f775 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.295s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:47:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:47:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7951MB free_disk=25.134593963623047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8a833f57-2ff5-481e-9bf3-6f845343bb20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:47:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:46 user nova-compute[75354]: INFO nova.compute.manager [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Detaching volume eae28cb8-6641-49ed-80e5-9bfc7e4a993e
Nov 14 06:47:46 user nova-compute[75354]: INFO nova.virt.block_device [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attempting to driver detach volume eae28cb8-6641-49ed-80e5-9bfc7e4a993e from mountpoint /dev/vdb
Nov 14 06:47:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Attempting to detach device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:47:46 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:47:46 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:47:46 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:47:46 user nova-compute[75354]:   <serial>eae28cb8-6641-49ed-80e5-9bfc7e4a993e</serial>
Nov 14 06:47:46 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:47:46 user nova-compute[75354]: </disk>
Nov 14 06:47:46 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:47:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config.
Nov 14 06:47:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:47:46 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:47:46 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 06:47:46 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:47:46 user nova-compute[75354]:   <serial>eae28cb8-6641-49ed-80e5-9bfc7e4a993e</serial>
Nov 14 06:47:46 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:47:46 user nova-compute[75354]: </disk>
Nov 14 06:47:46 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:47:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Updating instance_info_cache with network_info: [{"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:47:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing instance network info cache due to event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:47:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:47:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:47:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:53 user nova-compute[75354]: INFO nova.compute.manager [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Detaching volume 9c047d94-b532-4eb8-abef-5348ecc43ff5
Nov 14 06:47:53 user nova-compute[75354]: INFO nova.virt.block_device [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Attempting to driver detach volume 9c047d94-b532-4eb8-abef-5348ecc43ff5 from mountpoint /dev/vdb
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Attempting to detach device vdb from instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:47:53 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:47:53 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:47:53 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:47:53 user nova-compute[75354]:   <serial>9c047d94-b532-4eb8-abef-5348ecc43ff5</serial>
Nov 14 06:47:53 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:47:53 user nova-compute[75354]: </disk>
Nov 14 06:47:53 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:47:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully detached device vdb from instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 from the persistent domain config.
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:47:53 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:47:53 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:47:53 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:47:53 user nova-compute[75354]:   <serial>9c047d94-b532-4eb8-abef-5348ecc43ff5</serial>
Nov 14 06:47:53 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:47:53 user nova-compute[75354]: </disk>
Nov 14 06:47:53 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updated VIF entry in instance network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1e27c7cf-1bef-4ddd-8379-0ac8c13a1e08 req-3615a106-a8af-47aa-9974-7191249b0174 service nova] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:47:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing instance network info cache due to event network-changed-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] Acquiring lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] Acquired lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Refreshing network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updated VIF entry in instance network info cache for port 4dfd73ae-d00c-48d3-bd36-d25bbdf8b336. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [{"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:47:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-31f4cbde-a2d2-47b9-b702-136a966c5db6 req-d185d616-26fd-4e6f-a3f8-d93e4cd06ce8 service nova] Releasing lock "refresh_cache-852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:56 user nova-compute[75354]: INFO nova.compute.manager [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Terminating instance
Nov 14 06:47:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-e6646910-b4d6-4f52-8494-98e538829e6f req-0d1b694a-30bb-4ba6-bf8d-27ce780021cc service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-vif-unplugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e6646910-b4d6-4f52-8494-98e538829e6f req-0d1b694a-30bb-4ba6-bf8d-27ce780021cc service nova] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e6646910-b4d6-4f52-8494-98e538829e6f req-0d1b694a-30bb-4ba6-bf8d-27ce780021cc service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e6646910-b4d6-4f52-8494-98e538829e6f req-0d1b694a-30bb-4ba6-bf8d-27ce780021cc service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-e6646910-b4d6-4f52-8494-98e538829e6f req-0d1b694a-30bb-4ba6-bf8d-27ce780021cc service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] No waiting events found dispatching network-vif-unplugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:47:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-e6646910-b4d6-4f52-8494-98e538829e6f req-0d1b694a-30bb-4ba6-bf8d-27ce780021cc service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-vif-unplugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:47:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Instance destroyed successfully.
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lazy-loading 'resources' on Instance uuid d1a1c1bb-0d24-4cbe-8de7-cb0d837af163 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2132560613',display_name='tempest-ServersNegativeTestJSON-server-2132560613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2132560613',id=23,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0829bb25ebb344eeb7cc2cfbb6990db0',ramdisk_id='',reservation_id='r-b85b83av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-906617313',owner_user_name='tempest-ServersNegativeTestJSON-906617313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:39:22Z,user_data=None,user_id='1d439693760147d2aab8152ac87480fa',uuid=d1a1c1bb-0d24-4cbe-8de7-cb0d837af163,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converting VIF {"id": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "address": "fa:16:3e:6a:d5:9d", "network": {"id": "8c63903d-f78d-4323-b694-472d1dd1b108", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-795688424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0829bb25ebb344eeb7cc2cfbb6990db0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a0b32-93", "ovs_interfaceid": "b81a0b32-9341-4b0e-8402-9c845e0975f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG os_vif [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb81a0b32-93, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e1ae22c-9108-49f3-8f0a-fa7e20f7515b) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:47:57 user nova-compute[75354]: INFO os_vif [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=b81a0b32-9341-4b0e-8402-9c845e0975f6,network=Network(8c63903d-f78d-4323-b694-472d1dd1b108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a0b32-93')
Nov 14 06:47:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Deleting instance files /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163_del
Nov 14 06:47:57 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Deletion of /opt/stack/data/nova/instances/d1a1c1bb-0d24-4cbe-8de7-cb0d837af163_del complete
Nov 14 06:47:57 user nova-compute[75354]: INFO nova.compute.manager [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 06:47:57 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:47:57 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Took 0.45 seconds to deallocate network for instance.
Nov 14 06:47:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:47:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:58 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Deleted allocations for instance d1a1c1bb-0d24-4cbe-8de7-cb0d837af163
Nov 14 06:47:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f2d266ea-49a6-4dc2-872b-d0b677a87276 tempest-ServersNegativeTestJSON-906617313 tempest-ServersNegativeTestJSON-906617313-project-member] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:47:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] Acquiring lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:47:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:47:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] Lock "d1a1c1bb-0d24-4cbe-8de7-cb0d837af163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:47:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] No waiting events found dispatching network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:47:58 user nova-compute[75354]: WARNING nova.compute.manager [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received unexpected event network-vif-plugged-b81a0b32-9341-4b0e-8402-9c845e0975f6 for instance with vm_state deleted and task_state None.
Nov 14 06:47:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-9e992a6d-5e7e-4f2c-8c84-e3dc1dbaafa7 req-d87b2265-6a62-4951-8eeb-70395cbe4cb0 service nova] [instance: d1a1c1bb-0d24-4cbe-8de7-cb0d837af163] Received event network-vif-deleted-b81a0b32-9341-4b0e-8402-9c845e0975f6 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:06 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 is timed out.
Nov 14 06:48:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config.
Nov 14 06:48:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwgplOvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:06 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4482051-7918-4c62-9bbe-8ec043ab2791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:48:06 user nova-compute[75354]: No targets found.
Nov 14 06:48:06 user nova-compute[75354]: iSNS:
Nov 14 06:48:06 user nova-compute[75354]: No targets found.
Nov 14 06:48:06 user nova-compute[75354]: STATIC:
Nov 14 06:48:06 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5
Nov 14 06:48:06 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:06 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:06 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e
Nov 14 06:48:06 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:06 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:06 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:48:06 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:06 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:06 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:48:06 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:06 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:06 user nova-compute[75354]: FIRMWARE:
Nov 14 06:48:06 user nova-compute[75354]: No targets found.
Nov 14 06:48:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:48:06 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:48:06 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c2a36d-6d64-4cb9-a0f4-3c37994398b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb53204-2f40-4b1f-a341-973a4a4df2fa]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:06 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:48:06 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:06 user nova-compute[75354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e (non-flash)
Nov 14 06:48:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:06 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:48:06 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:06 user nova-compute[75354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e (non-flash)
Nov 14 06:48:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80742260e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed2cb81-ee6c-41d1-b882-98f9814a4a15]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207b9d9-c02d-4b6e-a9ce-e82378c5cd20]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[47abb54b-c0df-416e-bffb-ab355358e949]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb5c29-706e-415e-85b0-9175397926dc]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73363b84-31b5-493c-90a7-19c5f043b912]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3fbddb-f28c-42b3-9936-355e5b588c19]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260]
Nov 14 06:48:07 user nova-compute[75354]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e, portal: 172.16.0.220,3260] successful.
Nov 14 06:48:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae28cb8-6641-49ed-80e5-9bfc7e4a993e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31759a5-d01f-4d54-9d63-ab4737a26503]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== disconnect_volume: return (314ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:48:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b71ec8b9-d03e-4c83-8429-60fa67436bd5 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:48:10 user nova-compute[75354]: INFO nova.compute.claims [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Claim successful on node user
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:48:10 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.policy [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4616257fc4344844a8a7913673ae0a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85018ee44225437ab1d8b96c5fa4c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:48:10 user nova-compute[75354]: INFO nova.virt.block_device [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Booting with volume fe4974fc-256f-40f6-80d8-e780ace312e2 at /dev/vda
Nov 14 06:48:10 user nova-compute[75354]: DEBUG os_brick.utils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e116c42-7936-4e72-a873-09c4c0646892]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17040687-fba8-4573-9f47-01e12db11a6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4280a09-bebd-4611-b6d1-9e7a931cc20f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e234a40-d009-4ab5-b280-0851de258ff6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:48:10 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:48:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f90b48-eed3-42e0-88b6-d421f7651f23]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG os_brick.utils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:10 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating existing volume attachment record: ab83dc36-c4a0-4067-a966-c402353c60ba {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:48:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Successfully created port: ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Successfully updated port: ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-changed-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Refreshing instance network info cache due to event network-changed-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance network_info: |[{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Refreshing network info cache for port ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updated VIF entry in instance network info cache for port ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG nova.network.neutron [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:48:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d83df205-d5df-49a8-b356-a876a79a20a5 req-56d8ef5d-262f-42ba-a94d-fc36574ab1c5 service nova] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:48:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 is timed out.
Nov 14 06:48:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully detached device vdb from instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 from the live domain config.
Nov 14 06:48:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBvmINxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:13 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10639c-f8de-4166-822d-281110eabe96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:48:13 user nova-compute[75354]: No targets found.
Nov 14 06:48:13 user nova-compute[75354]: iSNS:
Nov 14 06:48:13 user nova-compute[75354]: No targets found.
Nov 14 06:48:13 user nova-compute[75354]: STATIC:
Nov 14 06:48:13 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5
Nov 14 06:48:13 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:13 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:13 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:48:13 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:13 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:13 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:48:13 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:48:13 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:48:13 user nova-compute[75354]: FIRMWARE:
Nov 14 06:48:13 user nova-compute[75354]: No targets found.
Nov 14 06:48:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:48:13 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:48:13 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fbfa80-0780-48c9-bcd4-d64be0f20bae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315b59a-431e-43e7-97ab-4a1eb0fd3d2a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:13 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:48:13 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:13 user nova-compute[75354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 (non-flash)
Nov 14 06:48:13 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743df880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:48:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad03efd3-93a6-409e-8fd5-aab501638497]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[671bd216-97f3-4376-83a7-19eee51dd148]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20df8b34-a4d9-4de9-9744-624b81b42c6e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8efc7-8b3f-4f67-a4a3-725db0fc5aae]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e6b5cb-3967-45f3-97a1-7fb9ea2c819e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9b020e-01f4-46fb-9063-0c14ab6dafd7]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260]
Nov 14 06:48:14 user nova-compute[75354]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5, portal: 172.16.0.220,3260] successful.
Nov 14 06:48:14 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c047d94-b532-4eb8-abef-5348ecc43ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de0e97-6c2b-4282-bfa1-57714203b2ea]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] <== disconnect_volume: return (311ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG nova.objects.instance [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'flavor' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-960fa45d-5900-4e85-bc7e-c38d970397ab tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:48:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Creating image(s)
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Ensure instance console log exists: /opt/stack/data/nova/instances/81afb686-fa45-43a2-a45a-1dbe0c7fecc0/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Start _get_guest_xml network_info=[{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81afb686-fa45-43a2-a45a-1dbe0c7fecc0', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe4974fc-256f-40f6-80d8-e780ace312e2', 'serial': 'fe4974fc-256f-40f6-80d8-e780ace312e2'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'ab83dc36-c4a0-4067-a966-c402353c60ba', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:48:15 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:15 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:15 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:15 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:15 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c821e3-277b-4622-8828-272f2fbfa254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:48:15 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5420c-b86d-4831-9a00-73695eece8a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2] added
Nov 14 06:48:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeacc0a-5724-4e7c-98da-284cd5d9bfec]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9bacb1-895e-45ab-babf-e9095971588b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VncmZqYK {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VncmZqYK" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef1047b-f1fc-4734-9d14-2c292998f1c4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VncmZqYK'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e0c347-4d8e-4d4f-88de-1c142f584c22]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1c224-e555-4496-a424-13a47bebfab5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d41bd9-93f2-4864-9254-ee5c8a64eabb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]
Nov 14 06:48:15 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.
Nov 14 06:48:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb04fe9-cace-44bf-bab3-ea48e48d6d1c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b842126d-fa1c-4544-9e78-949fb377622c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:15 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82361857-e162-4161-bb0e-7864d595eeff]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:48:15 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23532376663363933', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532376663363933', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659409402',display_name='tempest-ServerActionsTestOtherA-server-1659409402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659409402',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-w8sfr6w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=81afb686-fa45-43a2-a45a-1dbe0c7fecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.objects.instance [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'pci_devices' on Instance uuid 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:48:16 user nova-compute[75354]:   <uuid>81afb686-fa45-43a2-a45a-1dbe0c7fecc0</uuid>
Nov 14 06:48:16 user nova-compute[75354]:   <name>instance-00000021</name>
Nov 14 06:48:16 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:48:16 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:48:16 user nova-compute[75354]:   <metadata>
Nov 14 06:48:16 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:48:16 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:48:16 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherA-server-1659409402</nova:name>
Nov 14 06:48:16 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:48:15</nova:creationTime>
Nov 14 06:48:16 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:48:16 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:48:16 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:48:16 user nova-compute[75354]:       <nova:owner>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:user uuid="4616257fc4344844a8a7913673ae0a6a">tempest-ServerActionsTestOtherA-834998162-project-member</nova:user>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:project uuid="85018ee44225437ab1d8b96c5fa4c408">tempest-ServerActionsTestOtherA-834998162</nova:project>
Nov 14 06:48:16 user nova-compute[75354]:       </nova:owner>
Nov 14 06:48:16 user nova-compute[75354]:       <nova:ports>
Nov 14 06:48:16 user nova-compute[75354]:         <nova:port uuid="ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e">
Nov 14 06:48:16 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 06:48:16 user nova-compute[75354]:         </nova:port>
Nov 14 06:48:16 user nova-compute[75354]:       </nova:ports>
Nov 14 06:48:16 user nova-compute[75354]:     </nova:instance>
Nov 14 06:48:16 user nova-compute[75354]:   </metadata>
Nov 14 06:48:16 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:48:16 user nova-compute[75354]:     <system>
Nov 14 06:48:16 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:48:16 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:48:16 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:48:16 user nova-compute[75354]:       <entry name="serial">81afb686-fa45-43a2-a45a-1dbe0c7fecc0</entry>
Nov 14 06:48:16 user nova-compute[75354]:       <entry name="uuid">81afb686-fa45-43a2-a45a-1dbe0c7fecc0</entry>
Nov 14 06:48:16 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:48:16 user nova-compute[75354]:     </system>
Nov 14 06:48:16 user nova-compute[75354]:   </sysinfo>
Nov 14 06:48:16 user nova-compute[75354]:   <os>
Nov 14 06:48:16 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:48:16 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:48:16 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:48:16 user nova-compute[75354]:   </os>
Nov 14 06:48:16 user nova-compute[75354]:   <features>
Nov 14 06:48:16 user nova-compute[75354]:     <acpi/>
Nov 14 06:48:16 user nova-compute[75354]:     <apic/>
Nov 14 06:48:16 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:48:16 user nova-compute[75354]:   </features>
Nov 14 06:48:16 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:48:16 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:48:16 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:48:16 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:48:16 user nova-compute[75354]:   </clock>
Nov 14 06:48:16 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:48:16 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:48:16 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:48:16 user nova-compute[75354]:   </cpu>
Nov 14 06:48:16 user nova-compute[75354]:   <devices>
Nov 14 06:48:16 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:48:16 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:48:16 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 06:48:16 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:48:16 user nova-compute[75354]:       <serial>fe4974fc-256f-40f6-80d8-e780ace312e2</serial>
Nov 14 06:48:16 user nova-compute[75354]:     </disk>
Nov 14 06:48:16 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:48:16 user nova-compute[75354]:       <mac address="fa:16:3e:af:60:04"/>
Nov 14 06:48:16 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:48:16 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:48:16 user nova-compute[75354]:       <target dev="tapce9d1ffc-c4"/>
Nov 14 06:48:16 user nova-compute[75354]:     </interface>
Nov 14 06:48:16 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:48:16 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/81afb686-fa45-43a2-a45a-1dbe0c7fecc0/console.log" append="off"/>
Nov 14 06:48:16 user nova-compute[75354]:     </serial>
Nov 14 06:48:16 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:48:16 user nova-compute[75354]:     <video>
Nov 14 06:48:16 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:48:16 user nova-compute[75354]:     </video>
Nov 14 06:48:16 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:48:16 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:48:16 user nova-compute[75354]:     </rng>
Nov 14 06:48:16 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:48:16 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:48:16 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:48:16 user nova-compute[75354]:     </memballoon>
Nov 14 06:48:16 user nova-compute[75354]:   </devices>
Nov 14 06:48:16 user nova-compute[75354]: </domain>
Nov 14 06:48:16 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659409402',display_name='tempest-ServerActionsTestOtherA-server-1659409402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659409402',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-w8sfr6w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=81afb686-fa45-43a2-a45a-1dbe0c7fecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG os_vif [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faa7925f-6efb-59c0-8d8a-566e42b27660', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce9d1ffc-c4, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce9d1ffc-c4, col_values=(('qos', UUID('7f4896f2-28ab-4baa-9da7-cb5babfc4394')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce9d1ffc-c4, col_values=(('external_ids', {'iface-id': 'ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:60:04', 'vm-uuid': '81afb686-fa45-43a2-a45a-1dbe0c7fecc0'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:16 user nova-compute[75354]: INFO os_vif [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4')
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:48:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No VIF found with MAC fa:16:3e:af:60:04, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:48:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-4023547f-34a9-4fe3-994f-de9e99f8abd7 req-883fbcb9-e73d-4810-a155-f9aac1d8c970 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4023547f-34a9-4fe3-994f-de9e99f8abd7 req-883fbcb9-e73d-4810-a155-f9aac1d8c970 service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4023547f-34a9-4fe3-994f-de9e99f8abd7 req-883fbcb9-e73d-4810-a155-f9aac1d8c970 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4023547f-34a9-4fe3-994f-de9e99f8abd7 req-883fbcb9-e73d-4810-a155-f9aac1d8c970 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-4023547f-34a9-4fe3-994f-de9e99f8abd7 req-883fbcb9-e73d-4810-a155-f9aac1d8c970 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:18 user nova-compute[75354]: WARNING nova.compute.manager [req-4023547f-34a9-4fe3-994f-de9e99f8abd7 req-883fbcb9-e73d-4810-a155-f9aac1d8c970 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state building and task_state spawning.
Nov 14 06:48:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:48:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance spawned successfully.
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:20 user nova-compute[75354]: INFO nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-ac5ef0a6-1601-49a3-9e4b-ec6c4f95213b req-d7e15f15-3a7f-4608-9349-4ee23e5e779d service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ac5ef0a6-1601-49a3-9e4b-ec6c4f95213b req-d7e15f15-3a7f-4608-9349-4ee23e5e779d service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ac5ef0a6-1601-49a3-9e4b-ec6c4f95213b req-d7e15f15-3a7f-4608-9349-4ee23e5e779d service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ac5ef0a6-1601-49a3-9e4b-ec6c4f95213b req-d7e15f15-3a7f-4608-9349-4ee23e5e779d service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-ac5ef0a6-1601-49a3-9e4b-ec6c4f95213b req-d7e15f15-3a7f-4608-9349-4ee23e5e779d service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:20 user nova-compute[75354]: WARNING nova.compute.manager [req-ac5ef0a6-1601-49a3-9e4b-ec6c4f95213b req-d7e15f15-3a7f-4608-9349-4ee23e5e779d service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state building and task_state spawning.
Nov 14 06:48:20 user nova-compute[75354]: INFO nova.compute.manager [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Took 10.33 seconds to build instance.
Nov 14 06:48:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-474892b4-d49f-4067-ba73-ecab5b080cf6 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.418s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:37 user nova-compute[75354]: INFO nova.compute.manager [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Rescuing
Nov 14 06:48:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:48:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:48:37 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG nova.network.neutron [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updating instance_info_cache with network_info: [{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-b17b06c5-8698-4e36-a2f4-fb4a366158e5 req-b42cad01-61a0-4d54-aa4d-e3d66934a4a1 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b17b06c5-8698-4e36-a2f4-fb4a366158e5 req-b42cad01-61a0-4d54-aa4d-e3d66934a4a1 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b17b06c5-8698-4e36-a2f4-fb4a366158e5 req-b42cad01-61a0-4d54-aa4d-e3d66934a4a1 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b17b06c5-8698-4e36-a2f4-fb4a366158e5 req-b42cad01-61a0-4d54-aa4d-e3d66934a4a1 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-b17b06c5-8698-4e36-a2f4-fb4a366158e5 req-b42cad01-61a0-4d54-aa4d-e3d66934a4a1 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:38 user nova-compute[75354]: WARNING nova.compute.manager [req-b17b06c5-8698-4e36-a2f4-fb4a366158e5 req-b42cad01-61a0-4d54-aa4d-e3d66934a4a1 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state rescuing.
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:38 user nova-compute[75354]: INFO nova.compute.manager [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attaching volume fd34606e-a9ca-4ea6-9239-24db70fc35cc to /dev/vdb
Nov 14 06:48:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG os_brick.utils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f4cbea-3a81-47fb-8c06-f18a9b6dd0f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adcac79-9fc1-4a1b-b70e-949ed7d24a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ac3519-2b0f-4df4-b930-9fea23fbe3a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80da3b4c-1b16-405d-8249-330816500b8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:48:38 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:48:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[459f2b28-a91f-4f17-888d-c8609239ec46]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG os_brick.utils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:38 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating existing volume attachment record: bfd4fe03-3711-4aff-8bf7-5c604369de87 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance destroyed successfully.
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:48:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Attempting a stable device rescue
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:48:39 user nova-compute[75354]: INFO nova.compute.claims [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Claim successful on node user
Nov 14 06:48:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:48:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Creating image(s)
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "/opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "29f0f8530106e7f27e473d6b6b073f9cac647a51" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "29f0f8530106e7f27e473d6b6b073f9cac647a51" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG nova.virt.images [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] 31a55987-25db-43ad-be31-a2c312a3f73e was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.part /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-562dca6b-dd9c-4023-97be-d3138890cc88 req-0e287f6e-26ad-401a-a8d5-479864c6a622 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-562dca6b-dd9c-4023-97be-d3138890cc88 req-0e287f6e-26ad-401a-a8d5-479864c6a622 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-562dca6b-dd9c-4023-97be-d3138890cc88 req-0e287f6e-26ad-401a-a8d5-479864c6a622 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-562dca6b-dd9c-4023-97be-d3138890cc88 req-0e287f6e-26ad-401a-a8d5-479864c6a622 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-562dca6b-dd9c-4023-97be-d3138890cc88 req-0e287f6e-26ad-401a-a8d5-479864c6a622 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:40 user nova-compute[75354]: WARNING nova.compute.manager [req-562dca6b-dd9c-4023-97be-d3138890cc88 req-0e287f6e-26ad-401a-a8d5-479864c6a622 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state rescuing.
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.997s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.part /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.converted" returned: 0 in 0.564s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:48:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.policy [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a633fa123bb74524b360106dc68456b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930e51c7a6574779985bacd62c89cdf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "29f0f8530106e7f27e473d6b6b073f9cac647a51" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.200s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "29f0f8530106e7f27e473d6b6b073f9cac647a51" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "29f0f8530106e7f27e473d6b6b073f9cac647a51" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:48:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Creating image(s)
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51 --force-share --output=json" returned: 0 in 0.204s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51,backing_fmt=raw /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51,backing_fmt=raw /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue" returned: 0 in 0.052s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "29f0f8530106e7f27e473d6b6b073f9cac647a51" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'migration_context' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.201s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<8a833f57-2ff5-481e-9bf3-6f845343bb20> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Start _get_guest_xml network_info=[{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "vif_mac": "fa:16:3e:3a:2c:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '31a55987-25db-43ad-be31-a2c312a3f73e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8a833f57-2ff5-481e-9bf3-6f845343bb20', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'serial': 'bb0ef3b1-2048-4756-82d1-cb4c54e8c959'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'aea11505-6dc4-41a2-82a3-e92c24f08844', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'resources' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<8a833f57-2ff5-481e-9bf3-6f845343bb20> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<8a833f57-2ff5-481e-9bf3-6f845343bb20> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:48:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:41 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.objects.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<8a833f57-2ff5-481e-9bf3-6f845343bb20> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:41 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:41 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:41 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.210s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a609311a-f1ac-4e7a-83c8-17451000acac]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = swZORKiC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 06:48:41 user nova-compute[75354]: node.name = iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:48:41 user nova-compute[75354]: node.tpgt = -1
Nov 14 06:48:41 user nova-compute[75354]: node.startup = automatic
Nov 14 06:48:41 user nova-compute[75354]: node.leading_login = No
Nov 14 06:48:41 user nova-compute[75354]: iface.iscsi_ifacename = default
Nov 14 06:48:41 user nova-compute[75354]: iface.net_ifacename = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.ipaddress = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.prefix_len = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.hwaddress = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.transport_name = tcp
Nov 14 06:48:41 user nova-compute[75354]: iface.initiatorname = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.vlan_id = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.vlan_priority = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.vlan_state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.iface_num = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.mtu = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.port = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.bootproto = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.subnet_mask = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.gateway = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_alt_client_id = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_dns = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_learn_iqn = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_vendor_id_state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_vendor_id = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.dhcp_slp_da = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.fragmentation = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.gratuitous_arp = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.incoming_forwarding = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.tos_state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.tos = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.ttl = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.delayed_ack = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.tcp_nagle = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.tcp_wsf_state = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.tcp_wsf = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.tcp_timer_scale = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.tcp_timestamp = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.redirect = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.def_task_mgmt_timeout = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.header_digest = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.data_digest = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.immediate_data = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.initial_r2t = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.data_seq_inorder = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.data_pdu_inorder = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.erl = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.max_receive_data_len = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.first_burst_len = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.max_outstanding_r2t = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.max_burst_len = 0
Nov 14 06:48:41 user nova-compute[75354]: iface.chap_auth = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.bidi_chap = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.strict_login_compliance = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.discovery_auth = <empty>
Nov 14 06:48:41 user nova-compute[75354]: iface.discovery_logout = <empty>
Nov 14 06:48:41 user nova-compute[75354]: node.discovery_address = <empty>
Nov 14 06:48:41 user nova-compute[75354]: node.discovery_port = 0
Nov 14 06:48:41 user nova-compute[75354]: node.discovery_type = static
Nov 14 06:48:41 user nova-compute[75354]: node.session.initial_cmdsn = 0
Nov 14 06:48:41 user nova-compute[75354]: node.session.initial_login_retry_max = 8
Nov 14 06:48:41 user nova-compute[75354]: node.session.xmit_thread_priority = -20
Nov 14 06:48:41 user nova-compute[75354]: node.session.cmds_max = 128
Nov 14 06:48:41 user nova-compute[75354]: node.session.queue_depth = 32
Nov 14 06:48:41 user nova-compute[75354]: node.session.nr_sessions = 1
Nov 14 06:48:41 user nova-compute[75354]: node.session.auth.authmethod = CHAP
Nov 14 06:48:41 user nova-compute[75354]: node.session.auth.username = swZORKiC
Nov 14 06:48:41 user nova-compute[75354]: node.session.auth.password = ***
Nov 14 06:48:41 user nova-compute[75354]: node.session.auth.username_in = <empty>
Nov 14 06:48:41 user nova-compute[75354]: node.session.auth.password_in = <empty>
Nov 14 06:48:41 user nova-compute[75354]: node.session.auth.chap_algs = MD5
Nov 14 06:48:41 user nova-compute[75354]: node.session.timeo.replacement_timeout = 120
Nov 14 06:48:41 user nova-compute[75354]: node.session.err_timeo.abort_timeout = 15
Nov 14 06:48:41 user nova-compute[75354]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 06:48:41 user nova-compute[75354]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 06:48:41 user nova-compute[75354]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.FastAbort = Yes
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.InitialR2T = No
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.ImmediateData = Yes
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.MaxConnections = 1
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 06:48:41 user nova-compute[75354]: node.session.iscsi.ERL = 0
Nov 14 06:48:41 user nova-compute[75354]: node.session.scan = manual
Nov 14 06:48:41 user nova-compute[75354]: node.session.reopen_max = 0
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].address = 172.16.0.220
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].port = 3260
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].startup = manual
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].tcp.window_size = 524288
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].tcp.type_of_service = 0
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].timeo.logout_timeout = 15
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].timeo.login_timeout = 15
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].timeo.auth_timeout = 45
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].iscsi.DataDigest = None
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].iscsi.IFMarker = No
Nov 14 06:48:41 user nova-compute[75354]: node.conn[0].iscsi.OFMarker = No
Nov 14 06:48:41 user nova-compute[75354]: # END RECORD
Nov 14 06:48:41 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk 1073741824" returned: 0 in 0.055s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942dac5-2afc-4f31-a298-8e11051b3e48]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1c2ca-3d1e-424c-8e81-79e982d5850d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swZORKiC {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swZORKiC" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6935ac69-97a5-49e3-a019-c439f001d2d5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'swZORKiC'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Successfully created port: b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1942e50c-3ec4-4655-bc57-a1fb0738d92d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8449ee96-d6f0-4f52-b687-10ad3a6d9d21]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:42 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:42 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:42 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:42 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:42 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:42 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] HCTL ('34', '0', '0', 0) found on session 40 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75986ccd-04f6-44a4-b43b-e3d6fc0fcf68]: (4, ('0 0 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Searching for a device in session 40 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.299s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== connect_volume: return (301ms) {'type': 'block', 'scsi_wwn': '23731633663363436', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633663363436', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278141768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278141768',id=32,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:47:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-oglr9pef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:47:02Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=8a833f57-2ff5-481e-9bf3-6f845343bb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "vif_mac": "fa:16:3e:3a:2c:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "vif_mac": "fa:16:3e:3a:2c:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.objects.base [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Object Instance<8a833f57-2ff5-481e-9bf3-6f845343bb20> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:48:42 user nova-compute[75354]:   <uuid>8a833f57-2ff5-481e-9bf3-6f845343bb20</uuid>
Nov 14 06:48:42 user nova-compute[75354]:   <name>instance-00000020</name>
Nov 14 06:48:42 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:48:42 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:48:42 user nova-compute[75354]:   <metadata>
Nov 14 06:48:42 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:48:42 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:48:42 user nova-compute[75354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-278141768</nova:name>
Nov 14 06:48:42 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:48:41</nova:creationTime>
Nov 14 06:48:42 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:48:42 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:48:42 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:48:42 user nova-compute[75354]:       <nova:owner>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:user uuid="2dfc31b05a2848128a837f170ac63b93">tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member</nova:user>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:project uuid="7e0fdd525e8a49aeac22892962d8b14e">tempest-ServerBootFromVolumeStableRescueTest-1883221150</nova:project>
Nov 14 06:48:42 user nova-compute[75354]:       </nova:owner>
Nov 14 06:48:42 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:48:42 user nova-compute[75354]:       <nova:ports>
Nov 14 06:48:42 user nova-compute[75354]:         <nova:port uuid="594b7395-73d6-438d-b330-426c12f00771">
Nov 14 06:48:42 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 06:48:42 user nova-compute[75354]:         </nova:port>
Nov 14 06:48:42 user nova-compute[75354]:       </nova:ports>
Nov 14 06:48:42 user nova-compute[75354]:     </nova:instance>
Nov 14 06:48:42 user nova-compute[75354]:   </metadata>
Nov 14 06:48:42 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:48:42 user nova-compute[75354]:     <system>
Nov 14 06:48:42 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:48:42 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:48:42 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:48:42 user nova-compute[75354]:       <entry name="serial">8a833f57-2ff5-481e-9bf3-6f845343bb20</entry>
Nov 14 06:48:42 user nova-compute[75354]:       <entry name="uuid">8a833f57-2ff5-481e-9bf3-6f845343bb20</entry>
Nov 14 06:48:42 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:48:42 user nova-compute[75354]:     </system>
Nov 14 06:48:42 user nova-compute[75354]:   </sysinfo>
Nov 14 06:48:42 user nova-compute[75354]:   <os>
Nov 14 06:48:42 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:48:42 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:48:42 user nova-compute[75354]:   </os>
Nov 14 06:48:42 user nova-compute[75354]:   <features>
Nov 14 06:48:42 user nova-compute[75354]:     <acpi/>
Nov 14 06:48:42 user nova-compute[75354]:     <apic/>
Nov 14 06:48:42 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:48:42 user nova-compute[75354]:   </features>
Nov 14 06:48:42 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:48:42 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:48:42 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:48:42 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:48:42 user nova-compute[75354]:   </clock>
Nov 14 06:48:42 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:48:42 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:48:42 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:48:42 user nova-compute[75354]:   </cpu>
Nov 14 06:48:42 user nova-compute[75354]:   <devices>
Nov 14 06:48:42 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:48:42 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:48:42 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 06:48:42 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:48:42 user nova-compute[75354]:       <serial>bb0ef3b1-2048-4756-82d1-cb4c54e8c959</serial>
Nov 14 06:48:42 user nova-compute[75354]:     </disk>
Nov 14 06:48:42 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:48:42 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:48:42 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue"/>
Nov 14 06:48:42 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 06:48:42 user nova-compute[75354]:       <boot order="1"/>
Nov 14 06:48:42 user nova-compute[75354]:     </disk>
Nov 14 06:48:42 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:48:42 user nova-compute[75354]:       <mac address="fa:16:3e:3a:2c:72"/>
Nov 14 06:48:42 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:48:42 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:48:42 user nova-compute[75354]:       <target dev="tap594b7395-73"/>
Nov 14 06:48:42 user nova-compute[75354]:     </interface>
Nov 14 06:48:42 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:48:42 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/console.log" append="off"/>
Nov 14 06:48:42 user nova-compute[75354]:     </serial>
Nov 14 06:48:42 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:48:42 user nova-compute[75354]:     <video>
Nov 14 06:48:42 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:48:42 user nova-compute[75354]:     </video>
Nov 14 06:48:42 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:48:42 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:48:42 user nova-compute[75354]:     </rng>
Nov 14 06:48:42 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:48:42 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:48:42 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:48:42 user nova-compute[75354]:     </memballoon>
Nov 14 06:48:42 user nova-compute[75354]:   </devices>
Nov 14 06:48:42 user nova-compute[75354]: </domain>
Nov 14 06:48:42 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:48:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance destroyed successfully.
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Cannot resize image /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Ensure instance console log exists: /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] No VIF found with MAC fa:16:3e:3a:2c:72, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.428s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Successfully updated port: b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquired lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.compute.manager [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-changed-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.compute.manager [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Refreshing instance network info cache due to event network-changed-b01e40cb-f5c4-4b5c-86fa-840399a81d2a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] Acquiring lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRDsIYzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:48:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:48:43 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[29692d94-2653-480f-a827-3947a2226c6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:48:43 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5185770-8d1d-423c-aff9-1732f3011a52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc] added
Nov 14 06:48:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb2ad83-33b2-450f-8545-14e6e1daaf65]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9406f19d-d116-4fe0-b3a6-fcf6432e6b01]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRDsIYzd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRDsIYzd" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b03480-4ea6-4ca8-92cf-99a6f0eff586]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRDsIYzd'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f50d0-593a-435b-a8f4-84f808200baf]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a547d-f274-48c1-bfb0-b2f79ec3e900]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c5ec1f-9b8c-496d-b768-a28b6745e691]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260]
Nov 14 06:48:43 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260] successful.
Nov 14 06:48:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updating instance_info_cache with network_info: [{"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c7df4-329d-44d1-b010-8411558bcd8a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Releasing lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Instance network_info: |[{"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] Acquired lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.neutron [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Refreshing network info cache for port b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Start _get_guest_xml network_info=[{"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6905f95-3b34-4298-b00d-42364d0cc2a2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc (non-flash)
Nov 14 06:48:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:48:43 user nova-compute[75354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc (non-flash)
Nov 14 06:48:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:43 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2cf599-0777-48df-81f9-61f3696f31a1]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRDsIYzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-854765821',display_name='tempest-AttachVolumeNegativeTest-server-854765821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-854765821',id=34,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSS6NSLgoayr6G+2oyhE+48yK1DcFPxlhzgZCl3YU2eBMPngWz8Kz+xhiuGz0f4zD9deP04XH1aJkF3yEfxGzpraCp7deYqGMaO3HZtimCjqxFCUNm58PZxepvc4i3Nxw==',key_name='tempest-keypair-1015509865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-nzbgrvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=b2d4f9ab-0ae0-46cd-8059-1ac1d9363562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.objects.instance [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'pci_devices' on Instance uuid b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:48:43 user nova-compute[75354]:   <uuid>b2d4f9ab-0ae0-46cd-8059-1ac1d9363562</uuid>
Nov 14 06:48:43 user nova-compute[75354]:   <name>instance-00000022</name>
Nov 14 06:48:43 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:48:43 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:48:43 user nova-compute[75354]:   <metadata>
Nov 14 06:48:43 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:48:43 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:48:43 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-854765821</nova:name>
Nov 14 06:48:43 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:48:43</nova:creationTime>
Nov 14 06:48:43 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:48:43 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:48:43 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:48:43 user nova-compute[75354]:       <nova:owner>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:user uuid="a633fa123bb74524b360106dc68456b5">tempest-AttachVolumeNegativeTest-365177810-project-member</nova:user>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:project uuid="930e51c7a6574779985bacd62c89cdf6">tempest-AttachVolumeNegativeTest-365177810</nova:project>
Nov 14 06:48:43 user nova-compute[75354]:       </nova:owner>
Nov 14 06:48:43 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:48:43 user nova-compute[75354]:       <nova:ports>
Nov 14 06:48:43 user nova-compute[75354]:         <nova:port uuid="b01e40cb-f5c4-4b5c-86fa-840399a81d2a">
Nov 14 06:48:43 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 06:48:43 user nova-compute[75354]:         </nova:port>
Nov 14 06:48:43 user nova-compute[75354]:       </nova:ports>
Nov 14 06:48:43 user nova-compute[75354]:     </nova:instance>
Nov 14 06:48:43 user nova-compute[75354]:   </metadata>
Nov 14 06:48:43 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:48:43 user nova-compute[75354]:     <system>
Nov 14 06:48:43 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:48:43 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:48:43 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:48:43 user nova-compute[75354]:       <entry name="serial">b2d4f9ab-0ae0-46cd-8059-1ac1d9363562</entry>
Nov 14 06:48:43 user nova-compute[75354]:       <entry name="uuid">b2d4f9ab-0ae0-46cd-8059-1ac1d9363562</entry>
Nov 14 06:48:43 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:48:43 user nova-compute[75354]:     </system>
Nov 14 06:48:43 user nova-compute[75354]:   </sysinfo>
Nov 14 06:48:43 user nova-compute[75354]:   <os>
Nov 14 06:48:43 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:48:43 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:48:43 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:48:43 user nova-compute[75354]:   </os>
Nov 14 06:48:43 user nova-compute[75354]:   <features>
Nov 14 06:48:43 user nova-compute[75354]:     <acpi/>
Nov 14 06:48:43 user nova-compute[75354]:     <apic/>
Nov 14 06:48:43 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:48:43 user nova-compute[75354]:   </features>
Nov 14 06:48:43 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:48:43 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:48:43 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:48:43 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:48:43 user nova-compute[75354]:   </clock>
Nov 14 06:48:43 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:48:43 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:48:43 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:48:43 user nova-compute[75354]:   </cpu>
Nov 14 06:48:43 user nova-compute[75354]:   <devices>
Nov 14 06:48:43 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:48:43 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:48:43 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk"/>
Nov 14 06:48:43 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:48:43 user nova-compute[75354]:     </disk>
Nov 14 06:48:43 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:48:43 user nova-compute[75354]:       <mac address="fa:16:3e:ca:97:b3"/>
Nov 14 06:48:43 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:48:43 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:48:43 user nova-compute[75354]:       <target dev="tapb01e40cb-f5"/>
Nov 14 06:48:43 user nova-compute[75354]:     </interface>
Nov 14 06:48:43 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:48:43 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/console.log" append="off"/>
Nov 14 06:48:43 user nova-compute[75354]:     </serial>
Nov 14 06:48:43 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:48:43 user nova-compute[75354]:     <video>
Nov 14 06:48:43 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:48:43 user nova-compute[75354]:     </video>
Nov 14 06:48:43 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:48:43 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:48:43 user nova-compute[75354]:     </rng>
Nov 14 06:48:43 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:48:43 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:48:43 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:48:43 user nova-compute[75354]:     </memballoon>
Nov 14 06:48:43 user nova-compute[75354]:   </devices>
Nov 14 06:48:43 user nova-compute[75354]: </domain>
Nov 14 06:48:43 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-854765821',display_name='tempest-AttachVolumeNegativeTest-server-854765821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-854765821',id=34,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSS6NSLgoayr6G+2oyhE+48yK1DcFPxlhzgZCl3YU2eBMPngWz8Kz+xhiuGz0f4zD9deP04XH1aJkF3yEfxGzpraCp7deYqGMaO3HZtimCjqxFCUNm58PZxepvc4i3Nxw==',key_name='tempest-keypair-1015509865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-nzbgrvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=b2d4f9ab-0ae0-46cd-8059-1ac1d9363562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG os_vif [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '133757a5-41e3-5ad6-93dd-ab6d82710060', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:43 user nova-compute[75354]: INFO nova.compute.manager [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Terminating instance
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb01e40cb-f5, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb01e40cb-f5, col_values=(('qos', UUID('d11c9f32-e47e-4412-bf37-fb8e08926857')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb01e40cb-f5, col_values=(('external_ids', {'iface-id': 'b01e40cb-f5c4-4b5c-86fa-840399a81d2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:97:b3', 'vm-uuid': 'b2d4f9ab-0ae0-46cd-8059-1ac1d9363562'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:43 user nova-compute[75354]: INFO os_vif [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5')
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:ca:97:b3, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:48:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:48:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updated VIF entry in instance network info cache for port b01e40cb-f5c4-4b5c-86fa-840399a81d2a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.network.neutron [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updating instance_info_cache with network_info: [{"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.947s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== connect_volume: return (2950ms) {'type': 'block', 'scsi_wwn': '23134656662393138', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134656662393138', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-unplugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Acquiring lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] No waiting events found dispatching network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:46 user nova-compute[75354]: WARNING nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received unexpected event network-vif-plugged-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 for instance with vm_state active and task_state deleting.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:46 user nova-compute[75354]: WARNING nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state rescuing.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:46 user nova-compute[75354]: WARNING nova.compute.manager [req-d2f73565-1ccc-4ceb-94d3-8c9582bfa1f8 req-738d99c1-fbb8-4d84-a874-667ffefed77d service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state rescuing.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-6013a16b-8f18-4ce2-b83c-4bfb3e384417 req-2b76cf54-8589-431c-9718-17df5dc6d3d4 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6013a16b-8f18-4ce2-b83c-4bfb3e384417 req-2b76cf54-8589-431c-9718-17df5dc6d3d4 service nova] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6013a16b-8f18-4ce2-b83c-4bfb3e384417 req-2b76cf54-8589-431c-9718-17df5dc6d3d4 service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6013a16b-8f18-4ce2-b83c-4bfb3e384417 req-2b76cf54-8589-431c-9718-17df5dc6d3d4 service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-6013a16b-8f18-4ce2-b83c-4bfb3e384417 req-2b76cf54-8589-431c-9718-17df5dc6d3d4 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] No waiting events found dispatching network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:46 user nova-compute[75354]: WARNING nova.compute.manager [req-6013a16b-8f18-4ce2-b83c-4bfb3e384417 req-2b76cf54-8589-431c-9718-17df5dc6d3d4 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received unexpected event network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a for instance with vm_state building and task_state spawning.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-916dbbf6-fbb4-4cc0-a50f-9bdd22065c8d req-e69c4530-dddb-4958-bf80-3d1531dcacce service nova] Releasing lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:48:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8061MB free_disk=25.150768280029297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Instance destroyed successfully.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'resources' on Instance uuid 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-83301515',display_name='tempest-ServerRescueNegativeTestJSON-server-83301515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-83301515',id=29,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa2ds0jIml6nHt0nv3LhtVzVQ3D8kB2BL2c4R8ovmhPqGlvlgZQDtSKINF1zixKNX2QobsqBJzwO93FVaY9Kx+iE/W27SV50I3QqNpqSwmz0IuH8rgatDP4wwv3EFMLNQ==',key_name='tempest-keypair-49713527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-22b8wu0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=852ddc06-5bfb-42d9-bfb4-74fc93ab3a58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "address": "fa:16:3e:24:20:23", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfd73ae-d0", "ovs_interfaceid": "4dfd73ae-d00c-48d3-bd36-d25bbdf8b336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG os_vif [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dfd73ae-d0, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ceff866-e3af-48b4-954b-0b1f52064b64) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:48:46 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:48:46 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:48:46 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:48:46 user nova-compute[75354]:   <serial>fd34606e-a9ca-4ea6-9239-24db70fc35cc</serial>
Nov 14 06:48:46 user nova-compute[75354]: </disk>
Nov 14 06:48:46 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:48:46 user nova-compute[75354]: INFO os_vif [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:20:23,bridge_name='br-int',has_traffic_filtering=True,id=4dfd73ae-d00c-48d3-bd36-d25bbdf8b336,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfd73ae-d0')
Nov 14 06:48:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Deleting instance files /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58_del
Nov 14 06:48:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Deletion of /opt/stack/data/nova/instances/852ddc06-5bfb-42d9-bfb4-74fc93ab3a58_del complete
Nov 14 06:48:46 user nova-compute[75354]: INFO nova.compute.manager [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Took 2.58 seconds to destroy the instance on the hypervisor.
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8a833f57-2ff5-481e-9bf3-6f845343bb20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No VIF found with MAC fa:16:3e:6e:f8:92, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e22041d0-edbe-4623-9a18-a65c931cbb60 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.253s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:48:47 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Took 0.71 seconds to deallocate network for instance.
Nov 14 06:48:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-145ab35a-a17a-48f5-9297-fcadf8ad4e85 req-8276fb48-e222-425d-91fb-a6df10076e63 service nova] [instance: 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58] Received event network-vif-deleted-4dfd73ae-d00c-48d3-bd36-d25bbdf8b336 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f06e75fc-95d2-4279-ba9e-752156767883 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:48:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.737s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:47 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Deleted allocations for instance 852ddc06-5bfb-42d9-bfb4-74fc93ab3a58
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2c00268b-14d9-463f-a629-d6565e0fb795 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "852ddc06-5bfb-42d9-bfb4-74fc93ab3a58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.266s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-be096a51-e624-4817-88dc-578aa9a1e93d req-57dfcfb7-2ea1-443e-9932-7deb666bf508 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-be096a51-e624-4817-88dc-578aa9a1e93d req-57dfcfb7-2ea1-443e-9932-7deb666bf508 service nova] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-be096a51-e624-4817-88dc-578aa9a1e93d req-57dfcfb7-2ea1-443e-9932-7deb666bf508 service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-be096a51-e624-4817-88dc-578aa9a1e93d req-57dfcfb7-2ea1-443e-9932-7deb666bf508 service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-be096a51-e624-4817-88dc-578aa9a1e93d req-57dfcfb7-2ea1-443e-9932-7deb666bf508 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] No waiting events found dispatching network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:48:48 user nova-compute[75354]: WARNING nova.compute.manager [req-be096a51-e624-4817-88dc-578aa9a1e93d req-57dfcfb7-2ea1-443e-9932-7deb666bf508 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received unexpected event network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a for instance with vm_state building and task_state spawning.
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:48:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Instance spawned successfully.
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:48:48 user nova-compute[75354]: INFO nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:48 user nova-compute[75354]: INFO nova.compute.manager [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Took 9.58 seconds to build instance.
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-b2e78b6d-489b-487f-8b82-72744d3271ee tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.687s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:48:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:48:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:48:49 user nova-compute[75354]: INFO nova.compute.manager [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Detaching volume fd34606e-a9ca-4ea6-9239-24db70fc35cc
Nov 14 06:48:49 user nova-compute[75354]: INFO nova.virt.block_device [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attempting to driver detach volume fd34606e-a9ca-4ea6-9239-24db70fc35cc from mountpoint /dev/vdb
Nov 14 06:48:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Attempting to detach device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:48:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:48:49 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:48:49 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:48:49 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:48:49 user nova-compute[75354]:   <serial>fd34606e-a9ca-4ea6-9239-24db70fc35cc</serial>
Nov 14 06:48:49 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:48:49 user nova-compute[75354]: </disk>
Nov 14 06:48:49 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:48:49 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config.
Nov 14 06:48:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:48:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:48:49 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:48:49 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:48:49 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:48:49 user nova-compute[75354]:   <serial>fd34606e-a9ca-4ea6-9239-24db70fc35cc</serial>
Nov 14 06:48:49 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:48:49 user nova-compute[75354]: </disk>
Nov 14 06:48:49 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:48:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:48:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:48:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:48:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:48:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:48:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 is timed out.
Nov 14 06:49:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config.
Nov 14 06:49:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRDsIYzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:49:09 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb2207b-7aba-4863-9795-b3717241160b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:49:09 user nova-compute[75354]: No targets found.
Nov 14 06:49:09 user nova-compute[75354]: iSNS:
Nov 14 06:49:09 user nova-compute[75354]: No targets found.
Nov 14 06:49:09 user nova-compute[75354]: STATIC:
Nov 14 06:49:09 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:49:09 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:49:09 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:49:09 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc
Nov 14 06:49:09 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:49:09 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:49:09 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:49:09 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:49:09 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:49:09 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:49:09 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:49:09 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:49:09 user nova-compute[75354]: FIRMWARE:
Nov 14 06:49:09 user nova-compute[75354]: No targets found.
Nov 14 06:49:09 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:49:09 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:49:09 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f5d2b6-3586-42d1-88a3-5740df3c3bbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aeac94-e04c-4a9e-b64c-c28d2f5019fd]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:49:09 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:49:09 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:49:09 user nova-compute[75354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc (non-flash)
Nov 14 06:49:09 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:49:09 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:49:09 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:49:09 user nova-compute[75354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc (non-flash)
Nov 14 06:49:09 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80a14d3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3462b90-0b8f-4e1d-855b-1285eb269e10]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f923f8a0-543c-4c24-b194-500482c72ec1]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeb9563-6166-46ff-9419-bff856539be7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[326c2892-2e18-48c7-b003-3332ee14a1bf]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ba5ec-79cd-42c8-8caf-c577d8cf12d5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[554399a3-e40c-438e-9923-e64da55db0e6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260]
Nov 14 06:49:10 user nova-compute[75354]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc, portal: 172.16.0.220,3260] successful.
Nov 14 06:49:10 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd34606e-a9ca-4ea6-9239-24db70fc35cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034abad-41e8-450c-852b-c909379cd1d9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== disconnect_volume: return (311ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG nova.objects.instance [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:49:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-0929e199-23e8-44ab-9333-15e384f161ee tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:39 user nova-compute[75354]: INFO nova.compute.manager [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Terminating instance
Nov 14 06:49:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-99336719-a070-4008-80ea-d223aaf275b0 req-5aa18f1d-fce0-47d6-b1e4-f49de5355c19 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-unplugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99336719-a070-4008-80ea-d223aaf275b0 req-5aa18f1d-fce0-47d6-b1e4-f49de5355c19 service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99336719-a070-4008-80ea-d223aaf275b0 req-5aa18f1d-fce0-47d6-b1e4-f49de5355c19 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-99336719-a070-4008-80ea-d223aaf275b0 req-5aa18f1d-fce0-47d6-b1e4-f49de5355c19 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-99336719-a070-4008-80ea-d223aaf275b0 req-5aa18f1d-fce0-47d6-b1e4-f49de5355c19 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-unplugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-99336719-a070-4008-80ea-d223aaf275b0 req-5aa18f1d-fce0-47d6-b1e4-f49de5355c19 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-unplugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Instance destroyed successfully.
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'resources' on Instance uuid dce2abf5-a489-4d92-8a91-b3f436c53a50 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1517792480',display_name='tempest-ServerRescueNegativeTestJSON-server-1517792480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1517792480',id=14,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:35:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-hbtz4cbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:35:37Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=dce2abf5-a489-4d92-8a91-b3f436c53a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "596b67d5-4969-419f-a281-4b5722e48708", "address": "fa:16:3e:9d:d8:e9", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596b67d5-49", "ovs_interfaceid": "596b67d5-4969-419f-a281-4b5722e48708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG os_vif [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap596b67d5-49, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9d88a5b-6ed7-40fd-b738-9f31867efe64) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:40 user nova-compute[75354]: INFO os_vif [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=596b67d5-4969-419f-a281-4b5722e48708,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596b67d5-49')
Nov 14 06:49:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Deleting instance files /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50_del
Nov 14 06:49:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Deletion of /opt/stack/data/nova/instances/dce2abf5-a489-4d92-8a91-b3f436c53a50_del complete
Nov 14 06:49:40 user nova-compute[75354]: INFO nova.compute.manager [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 06:49:40 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:49:40 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Took 0.49 seconds to deallocate network for instance.
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-eb9bc8b8-7b02-4433-ba9d-b593c0c79ce4 req-d8fc1961-ccb9-4429-8a8c-c981c65deaf1 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-deleted-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:49:40 user nova-compute[75354]: INFO nova.compute.manager [req-eb9bc8b8-7b02-4433-ba9d-b593c0c79ce4 req-d8fc1961-ccb9-4429-8a8c-c981c65deaf1 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Neutron deleted interface 596b67d5-4969-419f-a281-4b5722e48708; detaching it from the instance and deleting it from the info cache
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.network.neutron [req-eb9bc8b8-7b02-4433-ba9d-b593c0c79ce4 req-d8fc1961-ccb9-4429-8a8c-c981c65deaf1 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-eb9bc8b8-7b02-4433-ba9d-b593c0c79ce4 req-d8fc1961-ccb9-4429-8a8c-c981c65deaf1 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Detach interface failed, port_id=596b67d5-4969-419f-a281-4b5722e48708, reason: Instance dce2abf5-a489-4d92-8a91-b3f436c53a50 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:49:41 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Deleted allocations for instance dce2abf5-a489-4d92-8a91-b3f436c53a50
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e693aec0-769b-4c10-a5f0-c9804ba64eb6 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:41 user nova-compute[75354]: INFO nova.compute.manager [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attaching volume 48b6a100-1c0f-4f27-9330-043f7dd31e7b to /dev/vdb
Nov 14 06:49:41 user nova-compute[75354]: DEBUG os_brick.utils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47b67f-b714-4bbc-9855-585db42c4da1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e89c89-95d3-41f7-b009-5471c996c5a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f9693-931f-488f-b4ff-d2f10547d737]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[996ccbf2-8b7e-47b0-9ede-e3249801e9bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-652a19d1-9943-4bf2-a4e1-fbb2add9728d req-9a799050-68c1-4b32-97aa-98d2cd4d7a81 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-652a19d1-9943-4bf2-a4e1-fbb2add9728d req-9a799050-68c1-4b32-97aa-98d2cd4d7a81 service nova] Acquiring lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-652a19d1-9943-4bf2-a4e1-fbb2add9728d req-9a799050-68c1-4b32-97aa-98d2cd4d7a81 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-652a19d1-9943-4bf2-a4e1-fbb2add9728d req-9a799050-68c1-4b32-97aa-98d2cd4d7a81 service nova] Lock "dce2abf5-a489-4d92-8a91-b3f436c53a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.compute.manager [req-652a19d1-9943-4bf2-a4e1-fbb2add9728d req-9a799050-68c1-4b32-97aa-98d2cd4d7a81 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] No waiting events found dispatching network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:49:41 user nova-compute[75354]: WARNING nova.compute.manager [req-652a19d1-9943-4bf2-a4e1-fbb2add9728d req-9a799050-68c1-4b32-97aa-98d2cd4d7a81 service nova] [instance: dce2abf5-a489-4d92-8a91-b3f436c53a50] Received unexpected event network-vif-plugged-596b67d5-4969-419f-a281-4b5722e48708 for instance with vm_state deleted and task_state None.
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:49:41 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d53045b-4cd4-4897-af09-01cbde0e9c8d]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG os_brick.utils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating existing volume attachment record: 7de8f0a0-0b3d-4160-a5a1-b6229e05061d {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:44 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:49:44 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7939MB free_disk=25.078235626220703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8a833f57-2ff5-481e-9bf3-6f845343bb20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:49:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXnKQjpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:49:45 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:49:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:49:45 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:49:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:49:45 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:49:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e2e2f-b925-4666-a03d-a07e95ecadea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:49:45 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108a23c-23db-4b1f-b055-ac85d1423a8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b] added
Nov 14 06:49:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83e4912-ddd9-4b7b-8da1-9d6b3618cc9c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45847cf3-b682-41d9-a224-681b80d5f8b4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXnKQjpg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXnKQjpg" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f67fd1-6adb-4505-a815-c6c52d6bdaf8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LXnKQjpg'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e249329-a9cd-4b41-b6d8-ab5833765e62]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62851a-f759-47be-ab05-0a11f3d7d9c7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a0b6f-8803-48d5-a202-705b55986ebc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260]
Nov 14 06:49:46 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260] successful.
Nov 14 06:49:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31281cfc-593c-410a-84db-1d6198814e72]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e226d0cc-2a0a-4e11-8bab-91be96643893]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)
Nov 14 06:49:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:49:46 user nova-compute[75354]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)
Nov 14 06:49:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[672354d7-ae49-4467-aca4-394ad486e938]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:49:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXnKQjpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26661333364306564', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661333364306564', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:49:47 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:49:47 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:49:47 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:49:47 user nova-compute[75354]:   <serial>48b6a100-1c0f-4f27-9330-043f7dd31e7b</serial>
Nov 14 06:49:47 user nova-compute[75354]: </disk>
Nov 14 06:49:47 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No VIF found with MAC fa:16:3e:6e:f8:92, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:49:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a07cf179-0b70-4cb7-8ee3-0ce33e322ded tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.474s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:49:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:49:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:49:49 user nova-compute[75354]: INFO nova.compute.manager [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Detaching volume 48b6a100-1c0f-4f27-9330-043f7dd31e7b
Nov 14 06:49:49 user nova-compute[75354]: INFO nova.virt.block_device [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attempting to driver detach volume 48b6a100-1c0f-4f27-9330-043f7dd31e7b from mountpoint /dev/vdb
Nov 14 06:49:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Attempting to detach device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:49:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:49:49 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:49:49 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:49:49 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:49:49 user nova-compute[75354]:   <serial>48b6a100-1c0f-4f27-9330-043f7dd31e7b</serial>
Nov 14 06:49:49 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:49:49 user nova-compute[75354]: </disk>
Nov 14 06:49:49 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:49:49 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config.
Nov 14 06:49:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:49:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:49:49 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:49:49 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:49:49 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:49:49 user nova-compute[75354]:   <serial>48b6a100-1c0f-4f27-9330-043f7dd31e7b</serial>
Nov 14 06:49:49 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:49:49 user nova-compute[75354]: </disk>
Nov 14 06:49:49 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [{"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-4f8c2f10-c9dc-4094-832a-bd5ea80160a3" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:49:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:49:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:49:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:49:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-changed-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Refreshing instance network info cache due to event network-changed-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:50:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] Acquiring lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] Acquired lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:01 user nova-compute[75354]: DEBUG nova.network.neutron [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Refreshing network info cache for port a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:50:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updated VIF entry in instance network info cache for port a3cd5c83-b585-4d06-9990-c2d4e9d1b96c. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:50:02 user nova-compute[75354]: DEBUG nova.network.neutron [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ddd2a852-7dea-4b09-8542-76c449cae438 req-e6c3f016-bfaf-4572-b46c-7171bd8989c3 service nova] Releasing lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Stashing vm_state: active {{(pid=75354) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-changed-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Refreshing instance network info cache due to event network-changed-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG nova.network.neutron [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Refreshing network info cache for port ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:03 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:50:03 user nova-compute[75354]: INFO nova.compute.claims [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Claim successful on node user
Nov 14 06:50:03 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating resource usage from migration 46aa10e6-2fc4-4823-b329-087734c0122e
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updated VIF entry in instance network info cache for port ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.383s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:04 user nova-compute[75354]: INFO nova.compute.manager [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Migrating
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-aaad779f-acb2-481b-b3cd-9ec01d5bcdde req-e7b4f151-4ffd-4b2a-a6c0-12c2767671e4 service nova] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:04 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:50:04 user nova-compute[75354]: INFO nova.compute.claims [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Claim successful on node user
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Starting migrate_disk_and_power_off {{(pid=75354) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-c07facd9-dd78-4f2f-bf51-3966e6030fcf req-d1c9cbd7-3e43-4bc8-bcb3-f68d934bec95 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c07facd9-dd78-4f2f-bf51-3966e6030fcf req-d1c9cbd7-3e43-4bc8-bcb3-f68d934bec95 service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c07facd9-dd78-4f2f-bf51-3966e6030fcf req-d1c9cbd7-3e43-4bc8-bcb3-f68d934bec95 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c07facd9-dd78-4f2f-bf51-3966e6030fcf req-d1c9cbd7-3e43-4bc8-bcb3-f68d934bec95 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-c07facd9-dd78-4f2f-bf51-3966e6030fcf req-d1c9cbd7-3e43-4bc8-bcb3-f68d934bec95 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:05 user nova-compute[75354]: WARNING nova.compute.manager [req-c07facd9-dd78-4f2f-bf51-3966e6030fcf req-d1c9cbd7-3e43-4bc8-bcb3-f68d934bec95 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_migrating.
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:50:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.policy [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '044d2b39ef8949daa9f883e35b8360eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aee1666dc694eb982ae85f399d1acda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:50:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Creating image(s)
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "/opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "/opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "/opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance destroyed successfully.
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659409402',display_name='tempest-ServerActionsTestOtherA-server-1659409402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659409402',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-w8sfr6w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=81afb686-fa45-43a2-a45a-1dbe0c7fecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce9d1ffc-c4, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f4896f2-28ab-4baa-9da7-cb5babfc4394) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:05 user nova-compute[75354]: INFO os_vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4')
Nov 14 06:50:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:05 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088a648-2a92-4bef-82c5-554095272b5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:50:05 user nova-compute[75354]: No targets found.
Nov 14 06:50:05 user nova-compute[75354]: iSNS:
Nov 14 06:50:05 user nova-compute[75354]: No targets found.
Nov 14 06:50:05 user nova-compute[75354]: STATIC:
Nov 14 06:50:05 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b
Nov 14 06:50:05 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:05 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:05 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:50:05 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:05 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:05 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:50:05 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:05 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:05 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:50:05 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:05 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:05 user nova-compute[75354]: FIRMWARE:
Nov 14 06:50:05 user nova-compute[75354]: No targets found.
Nov 14 06:50:05 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:50:05 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:50:05 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6775adb-4be0-4244-b0cc-9177d45339ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa284f-6a08-4841-8ace-de1dff0342f5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:05 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:05 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:05 user nova-compute[75354]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)
Nov 14 06:50:05 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:05 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:05 user nova-compute[75354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:05 user nova-compute[75354]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)
Nov 14 06:50:05 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741c05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.223s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d8eb9-a611-4436-a57c-7c4359e35709]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5773006-52fb-44ff-baa0-43a094052913]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7ead9-0597-449b-b9db-0589f6075e19]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec850d2b-e607-41c5-877c-4f3442ab671b]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6202680e-527fc693e57f2922', '/dev/disk/by-id/scsi-23532376663363933', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6202680e') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed1283c-5eed-493b-be1e-73a1920dd232]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5883c120-7d4b-4abc-a0e9-3097a59bdba7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.209s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e00591-72f2-4c88-b73d-12fab5349ce2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]
Nov 14 06:50:06 user nova-compute[75354]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.
Nov 14 06:50:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk 1073741824" returned: 0 in 0.060s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Successfully created port: fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b038fc6-adc8-44f7-9f68-5fcb63e72bf0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== disconnect_volume: return (422ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Cannot resize image /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Ensure instance console log exists: /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Successfully updated port: fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquired lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-changed-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Refreshing instance network info cache due to event network-changed-fb90c7c6-b5af-4e33-adda-6c6330369dc5. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] Acquiring lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating instance_info_cache with network_info: [{"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Releasing lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Instance network_info: |[{"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] Acquired lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Refreshing network info cache for port fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Start _get_guest_xml network_info=[{"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-486734701',display_name='tempest-TestServerVolumeAttachmentScenario-server-486734701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-486734701',id=35,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL3AAxs5HTOjdhgpgOr+MwsqoDoJ+BHsBn4NP8l7uqzg8YvRqUYeK6us6gnghEa5yXzHdwLX+K81DShI++VkRCVZmQ6dKmsIkS+55NblqfI/Q45lj8waJSIcBIORXqu/Q==',key_name='tempest-keypair-333943190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aee1666dc694eb982ae85f399d1acda',ramdisk_id='',reservation_id='r-g9ydxcka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-974435090',owner_user_name='tempest-TestServerVolumeAttachmentScenario-974435090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='044d2b39ef8949daa9f883e35b8360eb',uuid=119d8d28-91b2-42ca-9a68-8e7b81a965fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Converting VIF {"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'pci_devices' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:50:07 user nova-compute[75354]:   <uuid>119d8d28-91b2-42ca-9a68-8e7b81a965fc</uuid>
Nov 14 06:50:07 user nova-compute[75354]:   <name>instance-00000023</name>
Nov 14 06:50:07 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:50:07 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:50:07 user nova-compute[75354]:   <metadata>
Nov 14 06:50:07 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:50:07 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:50:07 user nova-compute[75354]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-486734701</nova:name>
Nov 14 06:50:07 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:50:07</nova:creationTime>
Nov 14 06:50:07 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:50:07 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:50:07 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:50:07 user nova-compute[75354]:       <nova:owner>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:user uuid="044d2b39ef8949daa9f883e35b8360eb">tempest-TestServerVolumeAttachmentScenario-974435090-project-member</nova:user>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:project uuid="2aee1666dc694eb982ae85f399d1acda">tempest-TestServerVolumeAttachmentScenario-974435090</nova:project>
Nov 14 06:50:07 user nova-compute[75354]:       </nova:owner>
Nov 14 06:50:07 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:50:07 user nova-compute[75354]:       <nova:ports>
Nov 14 06:50:07 user nova-compute[75354]:         <nova:port uuid="fb90c7c6-b5af-4e33-adda-6c6330369dc5">
Nov 14 06:50:07 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 06:50:07 user nova-compute[75354]:         </nova:port>
Nov 14 06:50:07 user nova-compute[75354]:       </nova:ports>
Nov 14 06:50:07 user nova-compute[75354]:     </nova:instance>
Nov 14 06:50:07 user nova-compute[75354]:   </metadata>
Nov 14 06:50:07 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:50:07 user nova-compute[75354]:     <system>
Nov 14 06:50:07 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:50:07 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:50:07 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:50:07 user nova-compute[75354]:       <entry name="serial">119d8d28-91b2-42ca-9a68-8e7b81a965fc</entry>
Nov 14 06:50:07 user nova-compute[75354]:       <entry name="uuid">119d8d28-91b2-42ca-9a68-8e7b81a965fc</entry>
Nov 14 06:50:07 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:50:07 user nova-compute[75354]:     </system>
Nov 14 06:50:07 user nova-compute[75354]:   </sysinfo>
Nov 14 06:50:07 user nova-compute[75354]:   <os>
Nov 14 06:50:07 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:50:07 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:50:07 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:50:07 user nova-compute[75354]:   </os>
Nov 14 06:50:07 user nova-compute[75354]:   <features>
Nov 14 06:50:07 user nova-compute[75354]:     <acpi/>
Nov 14 06:50:07 user nova-compute[75354]:     <apic/>
Nov 14 06:50:07 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:50:07 user nova-compute[75354]:   </features>
Nov 14 06:50:07 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:50:07 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:50:07 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:50:07 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:50:07 user nova-compute[75354]:   </clock>
Nov 14 06:50:07 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:50:07 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:50:07 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:50:07 user nova-compute[75354]:   </cpu>
Nov 14 06:50:07 user nova-compute[75354]:   <devices>
Nov 14 06:50:07 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:50:07 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:50:07 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk"/>
Nov 14 06:50:07 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:50:07 user nova-compute[75354]:     </disk>
Nov 14 06:50:07 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:50:07 user nova-compute[75354]:       <mac address="fa:16:3e:87:34:e3"/>
Nov 14 06:50:07 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:50:07 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:50:07 user nova-compute[75354]:       <target dev="tapfb90c7c6-b5"/>
Nov 14 06:50:07 user nova-compute[75354]:     </interface>
Nov 14 06:50:07 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:50:07 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/console.log" append="off"/>
Nov 14 06:50:07 user nova-compute[75354]:     </serial>
Nov 14 06:50:07 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:50:07 user nova-compute[75354]:     <video>
Nov 14 06:50:07 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:50:07 user nova-compute[75354]:     </video>
Nov 14 06:50:07 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:50:07 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:50:07 user nova-compute[75354]:     </rng>
Nov 14 06:50:07 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:50:07 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:50:07 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:50:07 user nova-compute[75354]:     </memballoon>
Nov 14 06:50:07 user nova-compute[75354]:   </devices>
Nov 14 06:50:07 user nova-compute[75354]: </domain>
Nov 14 06:50:07 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-486734701',display_name='tempest-TestServerVolumeAttachmentScenario-server-486734701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-486734701',id=35,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL3AAxs5HTOjdhgpgOr+MwsqoDoJ+BHsBn4NP8l7uqzg8YvRqUYeK6us6gnghEa5yXzHdwLX+K81DShI++VkRCVZmQ6dKmsIkS+55NblqfI/Q45lj8waJSIcBIORXqu/Q==',key_name='tempest-keypair-333943190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aee1666dc694eb982ae85f399d1acda',ramdisk_id='',reservation_id='r-g9ydxcka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-974435090',owner_user_name='tempest-TestServerVolumeAttachmentScenario-974435090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='044d2b39ef8949daa9f883e35b8360eb',uuid=119d8d28-91b2-42ca-9a68-8e7b81a965fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Converting VIF {"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG os_vif [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b7cd52f-98a9-57e0-8794-d9d81edbe540', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb90c7c6-b5, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb90c7c6-b5, col_values=(('qos', UUID('50dea12b-4ab5-45b5-b681-8dce9febebce')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb90c7c6-b5, col_values=(('external_ids', {'iface-id': 'fb90c7c6-b5af-4e33-adda-6c6330369dc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:34:e3', 'vm-uuid': '119d8d28-91b2-42ca-9a68-8e7b81a965fc'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_migrating.
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_migrating.
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_migrating.
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_migrating.
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:07 user nova-compute[75354]: WARNING nova.compute.manager [req-f4dbf3f6-e025-41bd-95d0-87b413d76c5d req-7c2a1aad-48ef-4c79-b26a-0feb4f627b3e service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_migrating.
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Port ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e binding to destination host user is already ACTIVE {{(pid=75354) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:07 user nova-compute[75354]: INFO os_vif [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5')
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No VIF found with MAC fa:16:3e:87:34:e3, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updated VIF entry in instance network info cache for port fb90c7c6-b5af-4e33-adda-6c6330369dc5. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating instance_info_cache with network_info: [{"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cae3e3e-7a0b-44a1-b0e9-9630cffb0d7d req-32fc04eb-c5dc-41f9-a25e-91d4fdc60142 service nova] Releasing lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG os_brick.utils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f63d6-52a8-43fb-bee4-50d6ef959ae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e5f7a-92eb-4fee-8341-6f28911ebe76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4c196f-87ce-42ee-a964-60d1d88abf8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d6858-76ce-44cd-96ed-8a7b8743c525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:50:08 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb00be2d-8aae-4db2-bbd7-e0bc5b1a448b]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG os_brick.utils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-f2e45524-2cfe-48b4-9a85-dcb28a3f3cbc req-a5bb8e66-af46-4b06-aa46-56c70a7463f3 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f2e45524-2cfe-48b4-9a85-dcb28a3f3cbc req-a5bb8e66-af46-4b06-aa46-56c70a7463f3 service nova] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f2e45524-2cfe-48b4-9a85-dcb28a3f3cbc req-a5bb8e66-af46-4b06-aa46-56c70a7463f3 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f2e45524-2cfe-48b4-9a85-dcb28a3f3cbc req-a5bb8e66-af46-4b06-aa46-56c70a7463f3 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-f2e45524-2cfe-48b4-9a85-dcb28a3f3cbc req-a5bb8e66-af46-4b06-aa46-56c70a7463f3 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] No waiting events found dispatching network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:08 user nova-compute[75354]: WARNING nova.compute.manager [req-f2e45524-2cfe-48b4-9a85-dcb28a3f3cbc req-a5bb8e66-af46-4b06-aa46-56c70a7463f3 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received unexpected event network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 for instance with vm_state building and task_state spawning.
Nov 14 06:50:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:10 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 is timed out.
Nov 14 06:50:10 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config.
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXnKQjpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:10 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[997e4b98-11b0-47ba-9fdb-c2905a287361]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:50:10 user nova-compute[75354]: No targets found.
Nov 14 06:50:10 user nova-compute[75354]: iSNS:
Nov 14 06:50:10 user nova-compute[75354]: No targets found.
Nov 14 06:50:10 user nova-compute[75354]: STATIC:
Nov 14 06:50:10 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b
Nov 14 06:50:10 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:10 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:10 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:50:10 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:10 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:10 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:50:10 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:50:10 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:50:10 user nova-compute[75354]: FIRMWARE:
Nov 14 06:50:10 user nova-compute[75354]: No targets found.
Nov 14 06:50:10 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:50:10 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:50:10 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c564dd-8cf1-4dfd-8d2e-adbd8c3f5412]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a568c83-f363-4d11-b214-ea0c48142f56]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:10 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:10 user nova-compute[75354]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)
Nov 14 06:50:10 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:10 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:10 user nova-compute[75354]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b (non-flash)
Nov 14 06:50:10 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741a2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c828c57-075a-494c-a1d9-bf325cc7861c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[905e39d7-6685-4c4e-826a-4b88c7b53a01]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6fdca-7966-41be-9b5b-9a9f409ec6f1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e3c59f-98ac-4d6a-b842-ac40395c5fb3]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94e875-b74e-49f3-8c19-b06d528b55d9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e8549e-f70f-4f7e-b552-c627fe329fc6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260]
Nov 14 06:50:10 user nova-compute[75354]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b, portal: 172.16.0.220,3260] successful.
Nov 14 06:50:10 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b6a100-1c0f-4f27-9330-043f7dd31e7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97da3260-c66e-44b1-b894-26e5b7ededbf]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== disconnect_volume: return (319ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:50:10 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Instance spawned successfully.
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-f3c72d94-4aaf-4c62-b695-d8f6749ee9e3 req-981d3aab-c70d-4fb8-b3b4-1aaa0a4886e3 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f3c72d94-4aaf-4c62-b695-d8f6749ee9e3 req-981d3aab-c70d-4fb8-b3b4-1aaa0a4886e3 service nova] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f3c72d94-4aaf-4c62-b695-d8f6749ee9e3 req-981d3aab-c70d-4fb8-b3b4-1aaa0a4886e3 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f3c72d94-4aaf-4c62-b695-d8f6749ee9e3 req-981d3aab-c70d-4fb8-b3b4-1aaa0a4886e3 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-f3c72d94-4aaf-4c62-b695-d8f6749ee9e3 req-981d3aab-c70d-4fb8-b3b4-1aaa0a4886e3 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] No waiting events found dispatching network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:11 user nova-compute[75354]: WARNING nova.compute.manager [req-f3c72d94-4aaf-4c62-b695-d8f6749ee9e3 req-981d3aab-c70d-4fb8-b3b4-1aaa0a4886e3 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received unexpected event network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 for instance with vm_state building and task_state spawning.
Nov 14 06:50:11 user nova-compute[75354]: INFO nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 14 06:50:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:50:11 user nova-compute[75354]: INFO nova.compute.manager [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Took 6.22 seconds to build instance.
Nov 14 06:50:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6bfe0253-c9f7-4d02-9db7-73176a7dbda9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.339s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f9761d23-530b-4153-b373-03ff54855956 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Starting finish_migration {{(pid=75354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance directory exists: not creating {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 06:50:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Creating image(s)
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Ensure instance console log exists: /opt/stack/data/nova/instances/81afb686-fa45-43a2-a45a-1dbe0c7fecc0/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Start _get_guest_xml network_info=[{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '81afb686-fa45-43a2-a45a-1dbe0c7fecc0', 'attached_at': '2023-11-14T06:50:12.000000', 'detached_at': '', 'volume_id': 'fe4974fc-256f-40f6-80d8-e780ace312e2', 'serial': 'fe4974fc-256f-40f6-80d8-e780ace312e2'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'd3a6fabd-eb4a-4809-9ad3-4f28eb3bcdac', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:50:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:12 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:12 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:12 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d68407-0cd4-4796-9bbc-fd471cc35bec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:50:12 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8708ab7-ddca-43cf-afaf-782178c758bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2] added
Nov 14 06:50:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e197f39-5d02-4b10-b232-9efd8278aa5e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05fc9c2-13e4-4aa5-a1df-2d7a1d326fbe]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VncmZqYK {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VncmZqYK" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f425127c-5907-47e4-8a6e-46d5e650ea0e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VncmZqYK'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04df4e0-5c89-4a61-a2ca-5149663a536e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c60969-0197-455e-91de-dbb2b1cf14ce]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbbc94-6f8f-4b19-9f6c-8b5d3bd2ce2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]
Nov 14 06:50:12 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.
Nov 14 06:50:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea86d70-12a8-4c2f-933b-9ea62aa5600f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31ec03-627f-4c07-a8bf-e8a12dc65cb4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf815c6-4374-4a1c-8fc9-1eed6c02f160]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:50:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23532376663363933', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532376663363933', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659409402',display_name='tempest-ServerActionsTestOtherA-server-1659409402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659409402',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-w8sfr6w5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=81afb686-fa45-43a2-a45a-1dbe0c7fecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:50:13 user nova-compute[75354]:   <uuid>81afb686-fa45-43a2-a45a-1dbe0c7fecc0</uuid>
Nov 14 06:50:13 user nova-compute[75354]:   <name>instance-00000021</name>
Nov 14 06:50:13 user nova-compute[75354]:   <memory>2097152</memory>
Nov 14 06:50:13 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:50:13 user nova-compute[75354]:   <metadata>
Nov 14 06:50:13 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:50:13 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:50:13 user nova-compute[75354]:       <nova:name>tempest-ServerActionsTestOtherA-server-1659409402</nova:name>
Nov 14 06:50:13 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:50:12</nova:creationTime>
Nov 14 06:50:13 user nova-compute[75354]:       <nova:flavor name="m1.small">
Nov 14 06:50:13 user nova-compute[75354]:         <nova:memory>2048</nova:memory>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:disk>20</nova:disk>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:50:13 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:50:13 user nova-compute[75354]:       <nova:owner>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:user uuid="4616257fc4344844a8a7913673ae0a6a">tempest-ServerActionsTestOtherA-834998162-project-member</nova:user>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:project uuid="85018ee44225437ab1d8b96c5fa4c408">tempest-ServerActionsTestOtherA-834998162</nova:project>
Nov 14 06:50:13 user nova-compute[75354]:       </nova:owner>
Nov 14 06:50:13 user nova-compute[75354]:       <nova:ports>
Nov 14 06:50:13 user nova-compute[75354]:         <nova:port uuid="ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e">
Nov 14 06:50:13 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 06:50:13 user nova-compute[75354]:         </nova:port>
Nov 14 06:50:13 user nova-compute[75354]:       </nova:ports>
Nov 14 06:50:13 user nova-compute[75354]:     </nova:instance>
Nov 14 06:50:13 user nova-compute[75354]:   </metadata>
Nov 14 06:50:13 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:50:13 user nova-compute[75354]:     <system>
Nov 14 06:50:13 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:50:13 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:50:13 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:50:13 user nova-compute[75354]:       <entry name="serial">81afb686-fa45-43a2-a45a-1dbe0c7fecc0</entry>
Nov 14 06:50:13 user nova-compute[75354]:       <entry name="uuid">81afb686-fa45-43a2-a45a-1dbe0c7fecc0</entry>
Nov 14 06:50:13 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:50:13 user nova-compute[75354]:     </system>
Nov 14 06:50:13 user nova-compute[75354]:   </sysinfo>
Nov 14 06:50:13 user nova-compute[75354]:   <os>
Nov 14 06:50:13 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:50:13 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:50:13 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:50:13 user nova-compute[75354]:   </os>
Nov 14 06:50:13 user nova-compute[75354]:   <features>
Nov 14 06:50:13 user nova-compute[75354]:     <acpi/>
Nov 14 06:50:13 user nova-compute[75354]:     <apic/>
Nov 14 06:50:13 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:50:13 user nova-compute[75354]:   </features>
Nov 14 06:50:13 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:50:13 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:50:13 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:50:13 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:50:13 user nova-compute[75354]:   </clock>
Nov 14 06:50:13 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:50:13 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:50:13 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:50:13 user nova-compute[75354]:   </cpu>
Nov 14 06:50:13 user nova-compute[75354]:   <devices>
Nov 14 06:50:13 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 06:50:13 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:50:13 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 06:50:13 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:50:13 user nova-compute[75354]:       <serial>fe4974fc-256f-40f6-80d8-e780ace312e2</serial>
Nov 14 06:50:13 user nova-compute[75354]:     </disk>
Nov 14 06:50:13 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:50:13 user nova-compute[75354]:       <mac address="fa:16:3e:af:60:04"/>
Nov 14 06:50:13 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:50:13 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:50:13 user nova-compute[75354]:       <target dev="tapce9d1ffc-c4"/>
Nov 14 06:50:13 user nova-compute[75354]:     </interface>
Nov 14 06:50:13 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:50:13 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/81afb686-fa45-43a2-a45a-1dbe0c7fecc0/console.log" append="off"/>
Nov 14 06:50:13 user nova-compute[75354]:     </serial>
Nov 14 06:50:13 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:50:13 user nova-compute[75354]:     <video>
Nov 14 06:50:13 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:50:13 user nova-compute[75354]:     </video>
Nov 14 06:50:13 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:50:13 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:50:13 user nova-compute[75354]:     </rng>
Nov 14 06:50:13 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:50:13 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:50:13 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:50:13 user nova-compute[75354]:     </memballoon>
Nov 14 06:50:13 user nova-compute[75354]:   </devices>
Nov 14 06:50:13 user nova-compute[75354]: </domain>
Nov 14 06:50:13 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659409402',display_name='tempest-ServerActionsTestOtherA-server-1659409402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659409402',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-w8sfr6w5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=81afb686-fa45-43a2-a45a-1dbe0c7fecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-458060275-network", "vif_mac": "fa:16:3e:af:60:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG os_vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faa7925f-6efb-59c0-8d8a-566e42b27660', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce9d1ffc-c4, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce9d1ffc-c4, col_values=(('qos', UUID('328a1fec-e16f-4722-89a1-2ae7cc8365de')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce9d1ffc-c4, col_values=(('external_ids', {'iface-id': 'ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:60:04', 'vm-uuid': '81afb686-fa45-43a2-a45a-1dbe0c7fecc0'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:13 user nova-compute[75354]: INFO os_vif [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4')
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] No VIF found with MAC fa:16:3e:af:60:04, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-6dd9cd83-2ee8-4033-808b-db2c1e6f52ae req-1cc97128-4b0b-412d-8659-923b6f7d7077 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6dd9cd83-2ee8-4033-808b-db2c1e6f52ae req-1cc97128-4b0b-412d-8659-923b6f7d7077 service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6dd9cd83-2ee8-4033-808b-db2c1e6f52ae req-1cc97128-4b0b-412d-8659-923b6f7d7077 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6dd9cd83-2ee8-4033-808b-db2c1e6f52ae req-1cc97128-4b0b-412d-8659-923b6f7d7077 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-6dd9cd83-2ee8-4033-808b-db2c1e6f52ae req-1cc97128-4b0b-412d-8659-923b6f7d7077 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:15 user nova-compute[75354]: WARNING nova.compute.manager [req-6dd9cd83-2ee8-4033-808b-db2c1e6f52ae req-1cc97128-4b0b-412d-8659-923b6f7d7077 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state resize_finish.
Nov 14 06:50:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:50:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance running successfully.
Nov 14 06:50:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Failed to set time: agent not configured {{(pid=75354) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-53f1530c-dc59-4fae-af9b-a5b2ba52756b tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] finish_migration finished successfully. {{(pid=75354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-c39bbd6f-528a-4b61-9303-63e0240df4bd req-dc14df98-54c7-43ce-816c-c82a25c83cfc service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c39bbd6f-528a-4b61-9303-63e0240df4bd req-dc14df98-54c7-43ce-816c-c82a25c83cfc service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c39bbd6f-528a-4b61-9303-63e0240df4bd req-dc14df98-54c7-43ce-816c-c82a25c83cfc service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c39bbd6f-528a-4b61-9303-63e0240df4bd req-dc14df98-54c7-43ce-816c-c82a25c83cfc service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-c39bbd6f-528a-4b61-9303-63e0240df4bd req-dc14df98-54c7-43ce-816c-c82a25c83cfc service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:17 user nova-compute[75354]: WARNING nova.compute.manager [req-c39bbd6f-528a-4b61-9303-63e0240df4bd req-dc14df98-54c7-43ce-816c-c82a25c83cfc service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state resized and task_state None.
Nov 14 06:50:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:28 user nova-compute[75354]: INFO nova.compute.manager [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Unrescuing
Nov 14 06:50:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquired lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:50:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updating instance_info_cache with network_info: [{"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Releasing lock "refresh_cache-8a833f57-2ff5-481e-9bf3-6f845343bb20" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'flavor' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-af2a3ed6-c869-4f99-88dd-2cf07953b45e req-2b6b079f-4278-45de-88f7-fdd8405edc71 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af2a3ed6-c869-4f99-88dd-2cf07953b45e req-2b6b079f-4278-45de-88f7-fdd8405edc71 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af2a3ed6-c869-4f99-88dd-2cf07953b45e req-2b6b079f-4278-45de-88f7-fdd8405edc71 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af2a3ed6-c869-4f99-88dd-2cf07953b45e req-2b6b079f-4278-45de-88f7-fdd8405edc71 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-af2a3ed6-c869-4f99-88dd-2cf07953b45e req-2b6b079f-4278-45de-88f7-fdd8405edc71 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:29 user nova-compute[75354]: WARNING nova.compute.manager [req-af2a3ed6-c869-4f99-88dd-2cf07953b45e req-2b6b079f-4278-45de-88f7-fdd8405edc71 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:50:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance destroyed successfully.
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-changed-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.compute.manager [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Refreshing instance network info cache due to event network-changed-b01e40cb-f5c4-4b5c-86fa-840399a81d2a. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] Acquiring lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] Acquired lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:29 user nova-compute[75354]: DEBUG nova.network.neutron [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Refreshing network info cache for port b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:30 user nova-compute[75354]: INFO nova.compute.manager [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Terminating instance
Nov 14 06:50:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updated VIF entry in instance network info cache for port b01e40cb-f5c4-4b5c-86fa-840399a81d2a. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG nova.network.neutron [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updating instance_info_cache with network_info: [{"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b8b663ac-0ecb-4df5-b7f0-ac54a95a39e1 req-ea9ea8c7-511e-4dfa-8a24-170603f9924c service nova] Releasing lock "refresh_cache-b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:31 user nova-compute[75354]: WARNING nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-unplugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Acquiring lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] No waiting events found dispatching network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:31 user nova-compute[75354]: WARNING nova.compute.manager [req-69bbe18a-254d-4caf-b79d-65e5f91b5fc7 req-931f308f-5d5d-44fe-bb70-0f4b9a38e099 service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received unexpected event network-vif-plugged-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b for instance with vm_state active and task_state deleting.
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Instance destroyed successfully.
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lazy-loading 'resources' on Instance uuid 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1459502704',display_name='tempest-ServerRescueNegativeTestJSON-server-1459502704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1459502704',id=13,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:38:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601a7175bd194f79b4ae31d34f724de4',ramdisk_id='',reservation_id='r-0i4xxzk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2059994566',owner_user_name='tempest-ServerRescueNegativeTestJSON-2059994566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:40:22Z,user_data=None,user_id='7f141a1ef1b44b34b09a8f2f88d5af17',uuid=4f8c2f10-c9dc-4094-832a-bd5ea80160a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converting VIF {"id": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "address": "fa:16:3e:da:e9:1b", "network": {"id": "e9487c46-9928-4f13-9be2-e40edd549bc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1772885505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601a7175bd194f79b4ae31d34f724de4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25cb9c60-0a", "ovs_interfaceid": "25cb9c60-0a6b-44e6-8ac3-56b1daa1608b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG os_vif [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25cb9c60-0a, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7204a5f6-7545-41db-91f1-dca08d307118) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: INFO os_vif [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:e9:1b,bridge_name='br-int',has_traffic_filtering=True,id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b,network=Network(e9487c46-9928-4f13-9be2-e40edd549bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25cb9c60-0a')
Nov 14 06:50:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Deleting instance files /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3_del
Nov 14 06:50:31 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Deletion of /opt/stack/data/nova/instances/4f8c2f10-c9dc-4094-832a-bd5ea80160a3_del complete
Nov 14 06:50:31 user nova-compute[75354]: INFO nova.compute.manager [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 14 06:50:31 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:32 user nova-compute[75354]: INFO nova.compute.manager [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Attaching volume a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 to /dev/vdb
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:32 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Took 0.53 seconds to deallocate network for instance.
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-26f2241a-218b-4a77-bf0e-94f8254c9f8e req-4dab65ad-ff6a-4f3d-948a-44198756fffa service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Received event network-vif-deleted-25cb9c60-0a6b-44e6-8ac3-56b1daa1608b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:32 user nova-compute[75354]: INFO nova.compute.manager [req-26f2241a-218b-4a77-bf0e-94f8254c9f8e req-4dab65ad-ff6a-4f3d-948a-44198756fffa service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Neutron deleted interface 25cb9c60-0a6b-44e6-8ac3-56b1daa1608b; detaching it from the instance and deleting it from the info cache
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-26f2241a-218b-4a77-bf0e-94f8254c9f8e req-4dab65ad-ff6a-4f3d-948a-44198756fffa service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-26f2241a-218b-4a77-bf0e-94f8254c9f8e req-4dab65ad-ff6a-4f3d-948a-44198756fffa service nova] [instance: 4f8c2f10-c9dc-4094-832a-bd5ea80160a3] Detach interface failed, port_id=25cb9c60-0a6b-44e6-8ac3-56b1daa1608b, reason: Instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4490cc4-8768-49bd-a85a-7eacb02b4207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b3d24-1329-430f-b2a6-d05820eaeec8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db55cc-81ac-43e4-a8d1-5d042276a932]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e5ca3-a743-4954-86cc-0331ec2841ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:50:32 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cac2c1a-8530-4e40-9225-228b541125b0]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG os_brick.utils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updating existing volume attachment record: 5ec3a98c-e71e-4b5a-8465-6b44c4322697 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:32 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Deleted allocations for instance 4f8c2f10-c9dc-4094-832a-bd5ea80160a3
Nov 14 06:50:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cdb331db-9308-4303-98aa-58535b4ee053 tempest-ServerRescueNegativeTestJSON-2059994566 tempest-ServerRescueNegativeTestJSON-2059994566-project-member] Lock "4f8c2f10-c9dc-4094-832a-bd5ea80160a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.717s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:33 user nova-compute[75354]: WARNING nova.compute.manager [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:50:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:33 user nova-compute[75354]: WARNING nova.compute.manager [req-d03c38a6-dcde-411a-961a-a030afc4e88b req-44080c53-0f6d-406c-919b-74cee8068302 service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state rescued and task_state unrescuing.
Nov 14 06:50:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2b6f6c93-bbbc-4bfe-853a-81825d6fd8b8 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvDoIbsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:36 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1123293c-6cb9-455f-b6cf-403c7a5fa557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:50:36 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3eb7a5-b4ae-46f7-a97f-a5ecdf2d83fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9] added
Nov 14 06:50:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d546b-717e-4072-8678-12c5682d899a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc22660-1a90-4bc6-9537-6ef2c4110c6a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvDoIbsJ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvDoIbsJ" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ee7254-e02d-4630-9688-a99259d019eb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvDoIbsJ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c702045-dae8-49e1-9f61-2d381a2439b2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67db28-e1f5-41d1-9a2c-d396b898e6b5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e48e93-e81e-44ae-b7d0-042c8b107ba9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260]
Nov 14 06:50:37 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260] successful.
Nov 14 06:50:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f57f762-27e2-4049-91e4-cf5363b42325]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f380f1e-3df2-4063-8fb9-5946171f2024]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:50:37 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[944b6de4-a80a-4cd7-8212-27ef45ef454b]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:50:37 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvDoIbsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23938353633366461', 'path': '/dev/sde'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938353633366461', 'path': '/dev/sde'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:50:38 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:50:38 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:50:38 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:50:38 user nova-compute[75354]:   <serial>a45d81f6-b8fb-414c-b0f5-5c3e4be133a9</serial>
Nov 14 06:50:38 user nova-compute[75354]: </disk>
Nov 14 06:50:38 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:ca:97:b3, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-94ae4f03-74d0-4545-9abc-872e09fe3d48 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.498s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG nova.objects.instance [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:42 user nova-compute[75354]: INFO nova.compute.manager [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attaching volume 7be2bd65-438e-4d67-be84-4f32000f29e6 to /dev/vdb
Nov 14 06:50:42 user nova-compute[75354]: DEBUG os_brick.utils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[946928b8-1b1e-4c2d-86b6-8fa70089291e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2c544a-ef77-4f55-a06d-4eefbe72fc25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf67e1-befc-49d9-8356-487eb0df00e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5b17f-ff16-4901-840e-1e2e1204c6b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:50:42 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bdb570-692c-46ab-b979-2998142ed308]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG os_brick.utils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating existing volume attachment record: e119ebfd-9724-4e4a-8c54-1433611aee9e {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:42 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:50:42 user nova-compute[75354]: INFO nova.compute.claims [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Claim successful on node user
Nov 14 06:50:42 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:50:43 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.policy [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a633fa123bb74524b360106dc68456b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930e51c7a6574779985bacd62c89cdf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:50:43 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Creating image(s)
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk 1073741824" returned: 0 in 0.057s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Successfully created port: 3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.200s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Cannot resize image /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Ensure instance console log exists: /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Successfully updated port: 3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquired lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-changed-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Refreshing instance network info cache due to event network-changed-3ffe093b-dbf7-4551-aebb-b13e999dbcf0. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] Acquiring lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updating instance_info_cache with network_info: [{"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Releasing lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Instance network_info: |[{"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] Acquired lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Refreshing network info cache for port 3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Start _get_guest_xml network_info=[{"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:50:45 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:45 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221328726',display_name='tempest-AttachVolumeNegativeTest-server-1221328726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221328726',id=36,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6lX7cBEEcAY6hr+1vO/1FSDeSnzlt//MCUsBiFhJ0Vgd8i7Bk1hCzEYNzBadD9dXpbzSRhJ5tjCUSsYW7uhD4J/F+AtmHjnxa6dWl9l5StgB743CxJvihn+XoW9HE6w==',key_name='tempest-keypair-197477684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-mx8v3fmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:50:45 user nova-compute[75354]:   <uuid>8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb</uuid>
Nov 14 06:50:45 user nova-compute[75354]:   <name>instance-00000024</name>
Nov 14 06:50:45 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:50:45 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:50:45 user nova-compute[75354]:   <metadata>
Nov 14 06:50:45 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:50:45 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:50:45 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1221328726</nova:name>
Nov 14 06:50:45 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:50:45</nova:creationTime>
Nov 14 06:50:45 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:50:45 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:50:45 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:50:45 user nova-compute[75354]:       <nova:owner>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:user uuid="a633fa123bb74524b360106dc68456b5">tempest-AttachVolumeNegativeTest-365177810-project-member</nova:user>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:project uuid="930e51c7a6574779985bacd62c89cdf6">tempest-AttachVolumeNegativeTest-365177810</nova:project>
Nov 14 06:50:45 user nova-compute[75354]:       </nova:owner>
Nov 14 06:50:45 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:50:45 user nova-compute[75354]:       <nova:ports>
Nov 14 06:50:45 user nova-compute[75354]:         <nova:port uuid="3ffe093b-dbf7-4551-aebb-b13e999dbcf0">
Nov 14 06:50:45 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 06:50:45 user nova-compute[75354]:         </nova:port>
Nov 14 06:50:45 user nova-compute[75354]:       </nova:ports>
Nov 14 06:50:45 user nova-compute[75354]:     </nova:instance>
Nov 14 06:50:45 user nova-compute[75354]:   </metadata>
Nov 14 06:50:45 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:50:45 user nova-compute[75354]:     <system>
Nov 14 06:50:45 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:50:45 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:50:45 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:50:45 user nova-compute[75354]:       <entry name="serial">8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb</entry>
Nov 14 06:50:45 user nova-compute[75354]:       <entry name="uuid">8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb</entry>
Nov 14 06:50:45 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:50:45 user nova-compute[75354]:     </system>
Nov 14 06:50:45 user nova-compute[75354]:   </sysinfo>
Nov 14 06:50:45 user nova-compute[75354]:   <os>
Nov 14 06:50:45 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:50:45 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:50:45 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:50:45 user nova-compute[75354]:   </os>
Nov 14 06:50:45 user nova-compute[75354]:   <features>
Nov 14 06:50:45 user nova-compute[75354]:     <acpi/>
Nov 14 06:50:45 user nova-compute[75354]:     <apic/>
Nov 14 06:50:45 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:50:45 user nova-compute[75354]:   </features>
Nov 14 06:50:45 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:50:45 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:50:45 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:50:45 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:50:45 user nova-compute[75354]:   </clock>
Nov 14 06:50:45 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:50:45 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:50:45 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:50:45 user nova-compute[75354]:   </cpu>
Nov 14 06:50:45 user nova-compute[75354]:   <devices>
Nov 14 06:50:45 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:50:45 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:50:45 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk"/>
Nov 14 06:50:45 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:50:45 user nova-compute[75354]:     </disk>
Nov 14 06:50:45 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:50:45 user nova-compute[75354]:       <mac address="fa:16:3e:3a:7c:af"/>
Nov 14 06:50:45 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:50:45 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:50:45 user nova-compute[75354]:       <target dev="tap3ffe093b-db"/>
Nov 14 06:50:45 user nova-compute[75354]:     </interface>
Nov 14 06:50:45 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:50:45 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/console.log" append="off"/>
Nov 14 06:50:45 user nova-compute[75354]:     </serial>
Nov 14 06:50:45 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:50:45 user nova-compute[75354]:     <video>
Nov 14 06:50:45 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:50:45 user nova-compute[75354]:     </video>
Nov 14 06:50:45 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:50:45 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:50:45 user nova-compute[75354]:     </rng>
Nov 14 06:50:45 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:50:45 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:50:45 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:50:45 user nova-compute[75354]:     </memballoon>
Nov 14 06:50:45 user nova-compute[75354]:   </devices>
Nov 14 06:50:45 user nova-compute[75354]: </domain>
Nov 14 06:50:45 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221328726',display_name='tempest-AttachVolumeNegativeTest-server-1221328726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221328726',id=36,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6lX7cBEEcAY6hr+1vO/1FSDeSnzlt//MCUsBiFhJ0Vgd8i7Bk1hCzEYNzBadD9dXpbzSRhJ5tjCUSsYW7uhD4J/F+AtmHjnxa6dWl9l5StgB743CxJvihn+XoW9HE6w==',key_name='tempest-keypair-197477684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-mx8v3fmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG os_vif [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a9929ed-b8ea-546b-a60a-38e17c040071', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ffe093b-db, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ffe093b-db, col_values=(('qos', UUID('d672f6bf-adac-4f55-b2c7-bea250429012')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ffe093b-db, col_values=(('external_ids', {'iface-id': '3ffe093b-dbf7-4551-aebb-b13e999dbcf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:7c:af', 'vm-uuid': '8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:45 user nova-compute[75354]: INFO os_vif [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db')
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:3a:7c:af, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updated VIF entry in instance network info cache for port 3ffe093b-dbf7-4551-aebb-b13e999dbcf0. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updating instance_info_cache with network_info: [{"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8984c026-f159-4e18-8ad5-c9f30b1ebef5 req-8bf1b229-40b4-4ecb-8e66-0cdd8fc9a342 service nova] Releasing lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:46 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7922MB free_disk=25.065685272216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Applying migration context for instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 as it has an incoming, in-progress migration 46aa10e6-2fc4-4823-b329-087734c0122e. Migration status is finished {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 06:50:46 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating resource usage from migration 46aa10e6-2fc4-4823-b329-087734c0122e
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8a833f57-2ff5-481e-9bf3-6f845343bb20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Migration 46aa10e6-2fc4-4823-b329-087734c0122e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-8d9ae436-da39-4288-8982-4ee35dc6fafd req-8bfcad11-de73-43d4-acd8-58de289cad32 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8d9ae436-da39-4288-8982-4ee35dc6fafd req-8bfcad11-de73-43d4-acd8-58de289cad32 service nova] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8d9ae436-da39-4288-8982-4ee35dc6fafd req-8bfcad11-de73-43d4-acd8-58de289cad32 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8d9ae436-da39-4288-8982-4ee35dc6fafd req-8bfcad11-de73-43d4-acd8-58de289cad32 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-8d9ae436-da39-4288-8982-4ee35dc6fafd req-8bfcad11-de73-43d4-acd8-58de289cad32 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] No waiting events found dispatching network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:46 user nova-compute[75354]: WARNING nova.compute.manager [req-8d9ae436-da39-4288-8982-4ee35dc6fafd req-8bfcad11-de73-43d4-acd8-58de289cad32 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received unexpected event network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 for instance with vm_state building and task_state spawning.
Nov 14 06:50:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZPKyCqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:50:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:50:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:50:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:50:46 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:50:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ad9e6-d571-43b8-b803-21a7d25f5ad7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:50:47 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb0e525-f418-4a0e-9e35-815424dc153f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6] added
Nov 14 06:50:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439c4e2-c86e-4f08-ad3c-19b2720d8968]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75c1fc4-ffc6-4bc5-86b4-5c49701f66f2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZPKyCqs {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZPKyCqs" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea6697c-7100-48d8-a385-f7d4766be3a3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZPKyCqs'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[65311f33-b91f-4e26-b1f7-641c0de9951d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1532aaef-2ba4-40b6-b4cd-77706f7505b1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[033c327c-d36e-4fa6-b7c0-5ad5c307610a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260]
Nov 14 06:50:47 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260] successful.
Nov 14 06:50:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b2e74f-eee0-49dc-bfbe-dabfb74e6b49]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1410908-c40c-497c-9cd2-200c4a6a00f0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 (non-flash)
Nov 14 06:50:47 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f57ca5-ce24-4bb2-902b-912d9236b1bd]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:50:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZPKyCqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23731323462666337', 'path': '/dev/sdf'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731323462666337', 'path': '/dev/sdf'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.objects.instance [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:50:48 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:50:48 user nova-compute[75354]:   <source dev="/dev/sdf"/>
Nov 14 06:50:48 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:50:48 user nova-compute[75354]:   <serial>7be2bd65-438e-4d67-be84-4f32000f29e6</serial>
Nov 14 06:50:48 user nova-compute[75354]: </disk>
Nov 14 06:50:48 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] No VIF found with MAC fa:16:3e:6e:f8:92, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:50:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Instance spawned successfully.
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-bc3561d1-f401-41a9-ae99-1a460f4a64e6 req-2ccb9c3a-70bd-4028-b383-086174621d38 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bc3561d1-f401-41a9-ae99-1a460f4a64e6 req-2ccb9c3a-70bd-4028-b383-086174621d38 service nova] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bc3561d1-f401-41a9-ae99-1a460f4a64e6 req-2ccb9c3a-70bd-4028-b383-086174621d38 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bc3561d1-f401-41a9-ae99-1a460f4a64e6 req-2ccb9c3a-70bd-4028-b383-086174621d38 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-bc3561d1-f401-41a9-ae99-1a460f4a64e6 req-2ccb9c3a-70bd-4028-b383-086174621d38 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] No waiting events found dispatching network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:50:48 user nova-compute[75354]: WARNING nova.compute.manager [req-bc3561d1-f401-41a9-ae99-1a460f4a64e6 req-2ccb9c3a-70bd-4028-b383-086174621d38 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received unexpected event network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 for instance with vm_state building and task_state spawning.
Nov 14 06:50:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-db1737d8-1d96-423b-a60c-8f0d983c00d7 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.601s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:48 user nova-compute[75354]: INFO nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 14 06:50:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:50:49 user nova-compute[75354]: INFO nova.compute.manager [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Took 6.49 seconds to build instance.
Nov 14 06:50:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2e51eb72-e5a7-4618-a492-d8f9ec18e869 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.630s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:50:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:49 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:50:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:50:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:50:51 user nova-compute[75354]: INFO nova.compute.manager [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Detaching volume 7be2bd65-438e-4d67-be84-4f32000f29e6
Nov 14 06:50:51 user nova-compute[75354]: INFO nova.virt.block_device [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Attempting to driver detach volume 7be2bd65-438e-4d67-be84-4f32000f29e6 from mountpoint /dev/vdb
Nov 14 06:50:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Attempting to detach device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:50:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:50:51 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:50:51 user nova-compute[75354]:   <source dev="/dev/sdf"/>
Nov 14 06:50:51 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:50:51 user nova-compute[75354]:   <serial>7be2bd65-438e-4d67-be84-4f32000f29e6</serial>
Nov 14 06:50:51 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:50:51 user nova-compute[75354]: </disk>
Nov 14 06:50:51 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:50:51 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the persistent domain config.
Nov 14 06:50:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:50:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:50:51 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:50:51 user nova-compute[75354]:   <source dev="/dev/sdf"/>
Nov 14 06:50:51 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:50:51 user nova-compute[75354]:   <serial>7be2bd65-438e-4d67-be84-4f32000f29e6</serial>
Nov 14 06:50:51 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:50:51 user nova-compute[75354]: </disk>
Nov 14 06:50:51 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:50:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updating instance_info_cache with network_info: [{"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-2b2f22af-1a41-4747-9a16-561e260d5f63" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:50:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:50:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:50:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 06:50:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 06:50:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:50:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 06:50:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 is timed out.
Nov 14 06:51:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully detached device vdb from instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 from the live domain config.
Nov 14 06:51:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZPKyCqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:51:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:51:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937417a-e099-48aa-b395-be0dd74b6080]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:51:11 user nova-compute[75354]: No targets found.
Nov 14 06:51:11 user nova-compute[75354]: iSNS:
Nov 14 06:51:11 user nova-compute[75354]: No targets found.
Nov 14 06:51:11 user nova-compute[75354]: STATIC:
Nov 14 06:51:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:51:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:51:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:51:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:51:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:51:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:51:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:51:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:51:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:51:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9
Nov 14 06:51:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:51:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:51:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6
Nov 14 06:51:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:51:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:51:11 user nova-compute[75354]: FIRMWARE:
Nov 14 06:51:11 user nova-compute[75354]: No targets found.
Nov 14 06:51:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:51:11 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:51:11 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:51:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c714d7-a8ad-4341-957d-4503e5263972]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95116e2f-af86-41b4-8aec-2303df944f87]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 (non-flash)
Nov 14 06:51:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80989313f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6'): ({'sdf'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Removing single pathed devices sdf {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a7aa3-121c-4ea0-ade8-1c217da27563]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05726dbb-e5ee-45fa-8f35-b6d1b0fa9a67]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Flushing IO for device /dev/sdf {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[639fc731-4591-46ec-9964-f2e328efb535]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ad13d-93db-42bf-9a95-d228149227a5]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] SCSI volumes sdf have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f957e-b1c1-4c0f-ad4d-491a4b13210b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad03ae3-230d-4dff-9674-0565f5a348b4]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260]
Nov 14 06:51:12 user nova-compute[75354]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6, portal: 172.16.0.220,3260] successful.
Nov 14 06:51:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be2bd65-438e-4d67-be84-4f32000f29e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca705e3-90d2-495d-a564-802de28658b7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] <== disconnect_volume: return (318ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:51:12 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'flavor' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:51:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8bee4f00-d0cc-4e49-8352-845565fe336a tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.635s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:51:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:51:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:51:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:51:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:51:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:51:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:51:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:51:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:44 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:51:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=25.018959045410156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Applying migration context for instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 as it has an incoming, in-progress migration 46aa10e6-2fc4-4823-b329-087734c0122e. Migration status is finished {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 06:51:48 user nova-compute[75354]: INFO nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating resource usage from migration 46aa10e6-2fc4-4823-b329-087734c0122e
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance dde78cdf-442b-4f1b-bbfa-bd25ae232264 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8a833f57-2ff5-481e-9bf3-6f845343bb20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Migration 46aa10e6-2fc4-4823-b329-087734c0122e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 06:51:48 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 06:51:49 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:51:49 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:51:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:51:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.885s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:51:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Going to confirm migration 2 {{(pid=75354) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [{"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-3e182ade-8d18-4fd0-a197-e4ea6d655e2d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:51:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'info_cache' on Instance uuid 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'migration_context' on Instance uuid 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.objects.base [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Object Instance<81afb686-fa45-43a2-a45a-1dbe0c7fecc0> lazy-loaded attributes: info_cache,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:54 user nova-compute[75354]: INFO nova.compute.manager [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Terminating instance
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-dd30c30c-b444-4cc8-844e-cb9912ae9f42 req-14d76bea-60c0-41ce-ad13-74887eb59ecc service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-vif-unplugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dd30c30c-b444-4cc8-844e-cb9912ae9f42 req-14d76bea-60c0-41ce-ad13-74887eb59ecc service nova] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dd30c30c-b444-4cc8-844e-cb9912ae9f42 req-14d76bea-60c0-41ce-ad13-74887eb59ecc service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dd30c30c-b444-4cc8-844e-cb9912ae9f42 req-14d76bea-60c0-41ce-ad13-74887eb59ecc service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-dd30c30c-b444-4cc8-844e-cb9912ae9f42 req-14d76bea-60c0-41ce-ad13-74887eb59ecc service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] No waiting events found dispatching network-vif-unplugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-dd30c30c-b444-4cc8-844e-cb9912ae9f42 req-14d76bea-60c0-41ce-ad13-74887eb59ecc service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-vif-unplugged-37631173-913d-4a25-991f-764ce7503b05 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.549s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:54 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Deleted allocation for migration 46aa10e6-2fc4-4823-b329-087734c0122e
Nov 14 06:51:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2d7b90a8-0863-4d41-8fd4-03af269e1d7d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.647s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Instance destroyed successfully.
Nov 14 06:51:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lazy-loading 'resources' on Instance uuid dde78cdf-442b-4f1b-bbfa-bd25ae232264 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:45:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-188955490',display_name='tempest-SnapshotDataIntegrityTests-server-188955490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-188955490',id=31,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2qDaFJs9gzTN5Yks2a6gnhysueyVbIu7Id72Fe/p1nSo/LgtuKett9fKjuLGYjP1VqDpDL9NNy4MSz2qllrssuLtrsj++7bcWKEO4jST0NcOkPrv2BwFimmU+KJ0nYgA==',key_name='tempest-keypair-1605347772',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eea0f7807ec54c9aae976efd94654288',ramdisk_id='',reservation_id='r-nkfvx160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2124672308',owner_user_name='tempest-SnapshotDataIntegrityTests-2124672308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07a91eeb60a543098e888519aca9473a',uuid=dde78cdf-442b-4f1b-bbfa-bd25ae232264,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Converting VIF {"id": "37631173-913d-4a25-991f-764ce7503b05", "address": "fa:16:3e:6e:f8:92", "network": {"id": "977d2294-29fb-4b09-b9f0-f9f744407383", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321115659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea0f7807ec54c9aae976efd94654288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37631173-91", "ovs_interfaceid": "37631173-913d-4a25-991f-764ce7503b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG os_vif [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37631173-91, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffd3f145-f9bf-4257-b4fc-63545e969995) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:51:55 user nova-compute[75354]: INFO os_vif [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f8:92,bridge_name='br-int',has_traffic_filtering=True,id=37631173-913d-4a25-991f-764ce7503b05,network=Network(977d2294-29fb-4b09-b9f0-f9f744407383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37631173-91')
Nov 14 06:51:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Deleting instance files /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264_del
Nov 14 06:51:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Deletion of /opt/stack/data/nova/instances/dde78cdf-442b-4f1b-bbfa-bd25ae232264_del complete
Nov 14 06:51:55 user nova-compute[75354]: INFO nova.compute.manager [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 06:51:55 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:51:55 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:51:56 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Took 0.87 seconds to deallocate network for instance.
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-759031c9-ceba-441f-af8e-85394a0bc4b0 req-143f8da2-c727-4731-9a59-ed5f150b3f06 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-vif-deleted-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.objects.instance [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'flavor' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:51:56 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Deleted allocations for instance dde78cdf-442b-4f1b-bbfa-bd25ae232264
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8b5581cd-7cd8-4841-abf6-99632ce86c15 tempest-SnapshotDataIntegrityTests-2124672308 tempest-SnapshotDataIntegrityTests-2124672308-project-member] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received event network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] Acquiring lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] Lock "dde78cdf-442b-4f1b-bbfa-bd25ae232264-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] No waiting events found dispatching network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:51:56 user nova-compute[75354]: WARNING nova.compute.manager [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: dde78cdf-442b-4f1b-bbfa-bd25ae232264] Received unexpected event network-vif-plugged-37631173-913d-4a25-991f-764ce7503b05 for instance with vm_state deleted and task_state None.
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-changed-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Refreshing instance network info cache due to event network-changed-fb90c7c6-b5af-4e33-adda-6c6330369dc5. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] Acquiring lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] Acquired lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Refreshing network info cache for port fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:51:56 user nova-compute[75354]: INFO nova.compute.manager [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attaching volume d823b503-c055-4291-9caa-bc167a3cdb21 to /dev/vdb
Nov 14 06:51:56 user nova-compute[75354]: DEBUG os_brick.utils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f074665-b372-44bd-b245-db39855be46a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cac93db-15e6-437c-bd23-acf90b5623b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d48fa0e-ac71-41e2-8369-31ca1c2806cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6c5882-8328-493f-842e-9192c59e668a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:51:57 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:51:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5d0dd1-a345-499e-9d8f-a1a97a32883e]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG os_brick.utils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating existing volume attachment record: 1e0ef48a-4019-42bb-8700-b9d6fff51f41 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updated VIF entry in instance network info cache for port fb90c7c6-b5af-4e33-adda-6c6330369dc5. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating instance_info_cache with network_info: [{"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:51:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bb7e265e-69d9-494e-80d6-76afa23d2e78 req-bbb5521f-37ab-49ce-88ee-975c74e05277 service nova] Releasing lock "refresh_cache-119d8d28-91b2-42ca-9a68-8e7b81a965fc" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:51:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:51:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SivKQAyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:52:01 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:52:01 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:52:01 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ef41a-3f10-4893-9720-5c1d8451cfd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:52:01 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02328376-0b10-4827-9e0c-9761eeaf111d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21] added
Nov 14 06:52:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b80b9e-41cb-4b9f-8d2e-045a1eab7913]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b762662-51a9-494c-b333-81448f5dacbe]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SivKQAyg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SivKQAyg" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6444ee-e88e-493d-a8f9-8ab8153c15b4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SivKQAyg'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f6857-e864-40fe-aed4-1a030a8a0efd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf5584-bed2-4f70-afad-6f63f72fc6b0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b04a8-fcb2-4952-b65e-f3d9da16091a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260]
Nov 14 06:52:01 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260] successful.
Nov 14 06:52:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a0de32-56bd-4dc8-a63f-407ee6f6c2f8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160988a-cc08-476f-a0d5-0fc34cc01548]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:01 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc74f76-34cd-4f15-a94f-3d7d13c61d8e]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:01 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SivKQAyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23163643836303164', 'path': '/dev/sdf'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163643836303164', 'path': '/dev/sdf'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG nova.objects.instance [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'flavor' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:52:02 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:52:02 user nova-compute[75354]:   <source dev="/dev/sdf"/>
Nov 14 06:52:02 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:52:02 user nova-compute[75354]:   <serial>d823b503-c055-4291-9caa-bc167a3cdb21</serial>
Nov 14 06:52:02 user nova-compute[75354]: </disk>
Nov 14 06:52:02 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:52:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No VIF found with MAC fa:16:3e:87:34:e3, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:52:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-52745930-bbef-4692-b627-813703e14fcf tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.259s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG nova.objects.instance [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'flavor' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:06 user nova-compute[75354]: INFO nova.compute.manager [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attaching volume 2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c to /dev/vdc
Nov 14 06:52:06 user nova-compute[75354]: DEBUG os_brick.utils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[526deaf6-27ce-4e12-9b7c-3843bedf913f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd91ffc-d446-4bd3-a0bc-6b1c1c0bdd13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3587d5-0406-4102-959c-4e29b9fda07a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c8f9e7-7c96-43fb-82a1-9dce156a4320]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:52:06 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:52:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb892716-8b1d-441d-8274-9b9093f177b3]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG os_brick.utils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:52:06 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating existing volume attachment record: 84c819de-a52a-4993-a548-de3beedee769 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:52:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZOTqhBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:52:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:52:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:52:11 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[841fbad7-ac56-4ed1-b277-e28775159db2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:52:11 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0bf28-9aa4-48a6-bdda-99c5a39e7c0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c] added
Nov 14 06:52:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3049dc6-662a-4914-a9c6-f86dace2531d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b0a904-dce3-4e0c-924e-19b3841109dd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZOTqhBt {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZOTqhBt" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8fed2-9e21-4d75-a5de-c9ab5d91a728]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZOTqhBt'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53550843-da02-463b-90c2-0d193aadb146]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[560fb35b-8828-4f69-8573-68bf4fdb1029]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d998ee4f-38e2-41ef-9f92-e8d85ca362eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260]
Nov 14 06:52:11 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260] successful.
Nov 14 06:52:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27244f-e197-4d90-9ca1-26e15849ba95]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2cbaf7-9696-475e-99bf-cbd0998a7f8f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)
Nov 14 06:52:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:11 user nova-compute[75354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)
Nov 14 06:52:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5a458-8b68-4a84-916b-c0df38cddabc]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:52:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZOTqhBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:52:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:52:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23663343037656330', 'path': '/dev/sdg'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:52:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663343037656330', 'path': '/dev/sdg'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG nova.objects.instance [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'flavor' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:52:13 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:52:13 user nova-compute[75354]:   <source dev="/dev/sdg"/>
Nov 14 06:52:13 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:52:13 user nova-compute[75354]:   <serial>2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c</serial>
Nov 14 06:52:13 user nova-compute[75354]: </disk>
Nov 14 06:52:13 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] No VIF found with MAC fa:16:3e:87:34:e3, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-768cada5-dbf0-4d66-b6df-8bc4bb9c2838 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.224s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:14 user nova-compute[75354]: INFO nova.compute.manager [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Detaching volume 2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c
Nov 14 06:52:14 user nova-compute[75354]: INFO nova.virt.block_device [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attempting to driver detach volume 2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c from mountpoint /dev/vdc
Nov 14 06:52:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Attempting to detach device vdc from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:52:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:52:14 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:52:14 user nova-compute[75354]:   <source dev="/dev/sdg"/>
Nov 14 06:52:14 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:52:14 user nova-compute[75354]:   <serial>2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c</serial>
Nov 14 06:52:14 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 06:52:14 user nova-compute[75354]: </disk>
Nov 14 06:52:14 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:52:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Successfully detached device vdc from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the persistent domain config.
Nov 14 06:52:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:52:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:52:14 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:52:14 user nova-compute[75354]:   <source dev="/dev/sdg"/>
Nov 14 06:52:14 user nova-compute[75354]:   <target dev="vdc" bus="virtio"/>
Nov 14 06:52:14 user nova-compute[75354]:   <serial>2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c</serial>
Nov 14 06:52:14 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 06:52:14 user nova-compute[75354]: </disk>
Nov 14 06:52:14 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:52:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:52:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:19 user nova-compute[75354]: INFO nova.compute.manager [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Terminating instance
Nov 14 06:52:19 user nova-compute[75354]: DEBUG nova.compute.manager [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-08686a2e-cc63-4e11-9f56-8aaf534daeb2 req-2671f60f-b307-419c-bac0-0b95acd25aec service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-08686a2e-cc63-4e11-9f56-8aaf534daeb2 req-2671f60f-b307-419c-bac0-0b95acd25aec service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-08686a2e-cc63-4e11-9f56-8aaf534daeb2 req-2671f60f-b307-419c-bac0-0b95acd25aec service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-08686a2e-cc63-4e11-9f56-8aaf534daeb2 req-2671f60f-b307-419c-bac0-0b95acd25aec service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-08686a2e-cc63-4e11-9f56-8aaf534daeb2 req-2671f60f-b307-419c-bac0-0b95acd25aec service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-08686a2e-cc63-4e11-9f56-8aaf534daeb2 req-2671f60f-b307-419c-bac0-0b95acd25aec service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Instance destroyed successfully.
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.objects.instance [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'resources' on Instance uuid 8a833f57-2ff5-481e-9bf3-6f845343bb20 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278141768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278141768',id=32,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-oglr9pef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:50:34Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=8a833f57-2ff5-481e-9bf3-6f845343bb20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "594b7395-73d6-438d-b330-426c12f00771", "address": "fa:16:3e:3a:2c:72", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594b7395-73", "ovs_interfaceid": "594b7395-73d6-438d-b330-426c12f00771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_vif [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap594b7395-73, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b769dde8-d859-41a3-939b-ee4d2419e762) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: INFO os_vif [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=594b7395-73d6-438d-b330-426c12f00771,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594b7395-73')
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swZORKiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:52:20 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37672171-a366-4751-bfc4-d8790a9106f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:52:20 user nova-compute[75354]: No targets found.
Nov 14 06:52:20 user nova-compute[75354]: iSNS:
Nov 14 06:52:20 user nova-compute[75354]: No targets found.
Nov 14 06:52:20 user nova-compute[75354]: STATIC:
Nov 14 06:52:20 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c
Nov 14 06:52:20 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:20 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:20 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:52:20 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:20 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:20 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21
Nov 14 06:52:20 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:20 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:20 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959
Nov 14 06:52:20 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:20 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:20 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:52:20 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:20 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:20 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9
Nov 14 06:52:20 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:20 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:20 user nova-compute[75354]: FIRMWARE:
Nov 14 06:52:20 user nova-compute[75354]: No targets found.
Nov 14 06:52:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:52:20 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:52:20 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dea6db-08fe-4a73-937e-c1653e496a09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9823b4b4-a911-4ec4-a59d-4df16035a506]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)
Nov 14 06:52:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:20 user nova-compute[75354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)
Nov 14 06:52:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074456320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5760ee5-c894-41b8-9091-a125b88323d1]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b3fbc-58c6-44ed-b2c1-5aaad8ff009d]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a072bb05-6129-4baa-a286-f808aa320ff1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8954f9-5e26-4044-ac04-ff55d333f72f]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf3a316d3-71c6c646fca044d4', '/dev/disk/by-id/scsi-23731633663363436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f3a316d3') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 06:52:20 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f3a316d3
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28908e48-c798-4a42-b502-539f6cddb21f]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b722cd-17a5-49c0-83fa-75aa674faef1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba1e961-9bd3-43c4-a418-e9a9326ee14a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260]
Nov 14 06:52:20 user nova-compute[75354]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959, portal: 172.16.0.220,3260] successful.
Nov 14 06:52:20 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0ef3b1-2048-4756-82d1-cb4c54e8c959 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c7d12e-85d2-4125-ac19-28448c309f49]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== disconnect_volume: return (377ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:52:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Deleting instance files /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20_del
Nov 14 06:52:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Deletion of /opt/stack/data/nova/instances/8a833f57-2ff5-481e-9bf3-6f845343bb20_del complete
Nov 14 06:52:20 user nova-compute[75354]: INFO nova.compute.manager [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 06:52:20 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:52:21 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Took 0.55 seconds to deallocate network for instance.
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:21 user nova-compute[75354]: WARNING nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state deleting.
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:21 user nova-compute[75354]: WARNING nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state deleting.
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:21 user nova-compute[75354]: WARNING nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state deleting.
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-unplugged-594b7395-73d6-438d-b330-426c12f00771 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Acquiring lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] No waiting events found dispatching network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:21 user nova-compute[75354]: WARNING nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received unexpected event network-vif-plugged-594b7395-73d6-438d-b330-426c12f00771 for instance with vm_state active and task_state deleting.
Nov 14 06:52:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-d253a1f2-521b-459d-b2fa-3966702ac867 req-26725094-9a84-4fb0-bb9e-4554fb837e1e service nova] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Received event network-vif-deleted-594b7395-73d6-438d-b330-426c12f00771 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:22 user nova-compute[75354]: INFO nova.compute.manager [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 8a833f57-2ff5-481e-9bf3-6f845343bb20] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 06:52:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:22 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:52:22 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:52:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:22 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Deleted allocations for instance 8a833f57-2ff5-481e-9bf3-6f845343bb20
Nov 14 06:52:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d980fd55-05b8-4fda-9919-0431a90bfa00 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "8a833f57-2ff5-481e-9bf3-6f845343bb20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.250s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-changed-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Refreshing instance network info cache due to event network-changed-3ffe093b-dbf7-4551-aebb-b13e999dbcf0. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] Acquiring lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] Acquired lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Refreshing network info cache for port 3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updated VIF entry in instance network info cache for port 3ffe093b-dbf7-4551-aebb-b13e999dbcf0. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updating instance_info_cache with network_info: [{"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2529fde0-aaa3-40c6-b8d5-2c527020e82a req-3d830f14-9769-4268-95b4-515dccc9df8a service nova] Releasing lock "refresh_cache-8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:33 user nova-compute[75354]: INFO nova.compute.manager [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Terminating instance
Nov 14 06:52:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Instance destroyed successfully.
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.objects.instance [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'resources' on Instance uuid 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221328726',display_name='tempest-AttachVolumeNegativeTest-server-1221328726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221328726',id=36,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6lX7cBEEcAY6hr+1vO/1FSDeSnzlt//MCUsBiFhJ0Vgd8i7Bk1hCzEYNzBadD9dXpbzSRhJ5tjCUSsYW7uhD4J/F+AtmHjnxa6dWl9l5StgB743CxJvihn+XoW9HE6w==',key_name='tempest-keypair-197477684',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-mx8v3fmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:50:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "address": "fa:16:3e:3a:7c:af", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffe093b-db", "ovs_interfaceid": "3ffe093b-dbf7-4551-aebb-b13e999dbcf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_vif [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ffe093b-db, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d672f6bf-adac-4f55-b2c7-bea250429012) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:34 user nova-compute[75354]: INFO os_vif [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7c:af,bridge_name='br-int',has_traffic_filtering=True,id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffe093b-db')
Nov 14 06:52:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Deleting instance files /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb_del
Nov 14 06:52:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Deletion of /opt/stack/data/nova/instances/8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb_del complete
Nov 14 06:52:34 user nova-compute[75354]: INFO nova.compute.manager [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:52:34 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc is timed out.
Nov 14 06:52:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Successfully detached device vdc from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the live domain config.
Nov 14 06:52:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZOTqhBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:52:34 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[431606d6-5163-4e4e-8f8a-ff17f3bde3ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:52:34 user nova-compute[75354]: No targets found.
Nov 14 06:52:34 user nova-compute[75354]: iSNS:
Nov 14 06:52:34 user nova-compute[75354]: No targets found.
Nov 14 06:52:34 user nova-compute[75354]: STATIC:
Nov 14 06:52:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c
Nov 14 06:52:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:52:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21
Nov 14 06:52:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:52:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:34 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9
Nov 14 06:52:34 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:52:34 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:52:34 user nova-compute[75354]: FIRMWARE:
Nov 14 06:52:34 user nova-compute[75354]: No targets found.
Nov 14 06:52:34 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:52:34 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:52:34 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc3116-5b1d-4302-8aae-40205fa9aaa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2600a-1dda-43fe-b3e6-ff183c4fa255]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)
Nov 14 06:52:34 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:52:34 user nova-compute[75354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c (non-flash)
Nov 14 06:52:34 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741a2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c'): ({'sdg'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Removing single pathed devices sdg {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d1c959-4ac4-417d-af87-3ce648619855]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1adf5-1669-43eb-9fd9-a756fb8c91b9]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Flushing IO for device /dev/sdg {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f0102a-872c-40da-ab53-8e985a78816a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa76cf-7529-4b0a-ac1c-543590c1a792]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] SCSI volumes sdg have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee384d4-5506-4327-a3c6-53f1dc1e1aa8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a2bdf-7b23-49f7-ac3e-dcdd65b3b522]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260]
Nov 14 06:52:35 user nova-compute[75354]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c, portal: 172.16.0.220,3260] successful.
Nov 14 06:52:35 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa1dc72-e1a1-4e57-9ba0-56513ff8b18c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[85696257-5836-4b59-9558-3d6411030976]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] <== disconnect_volume: return (332ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:52:35 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Took 0.64 seconds to deallocate network for instance.
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-b3399534-b54c-4ee1-bf21-b6fef4c9f5a8 req-3e85f1a5-403d-40a1-83e7-e1b0f617daaf service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-vif-deleted-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:35 user nova-compute[75354]: INFO nova.compute.manager [req-b3399534-b54c-4ee1-bf21-b6fef4c9f5a8 req-3e85f1a5-403d-40a1-83e7-e1b0f617daaf service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Neutron deleted interface 3ffe093b-dbf7-4551-aebb-b13e999dbcf0; detaching it from the instance and deleting it from the info cache
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-b3399534-b54c-4ee1-bf21-b6fef4c9f5a8 req-3e85f1a5-403d-40a1-83e7-e1b0f617daaf service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-b3399534-b54c-4ee1-bf21-b6fef4c9f5a8 req-3e85f1a5-403d-40a1-83e7-e1b0f617daaf service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Detach interface failed, port_id=3ffe093b-dbf7-4551-aebb-b13e999dbcf0, reason: Instance 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-vif-unplugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] No waiting events found dispatching network-vif-unplugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:35 user nova-compute[75354]: WARNING nova.compute.manager [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received unexpected event network-vif-unplugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 for instance with vm_state deleted and task_state None.
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received event network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] Acquiring lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] No waiting events found dispatching network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:52:35 user nova-compute[75354]: WARNING nova.compute.manager [req-acb6db0b-a27d-4ce2-9800-2c68b30a999f req-41afb9eb-901f-417a-ba86-2a9e3307d030 service nova] [instance: 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb] Received unexpected event network-vif-plugged-3ffe093b-dbf7-4551-aebb-b13e999dbcf0 for instance with vm_state deleted and task_state None.
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:35 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Deleted allocations for instance 8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-98966555-158e-4560-90aa-dad377271501 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "8d2fea2c-3bd9-4fc7-9e46-32a25ef737bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.006s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG nova.objects.instance [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'flavor' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:52:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-40666eff-f679-41ef-821d-8c4ec5d4b0b9 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:45 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:52:49 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:52:49 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8286MB free_disk=25.06240463256836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:52:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:52:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:52:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [{"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-9fa44e1b-6893-43f1-a435-3ef2fc914a1d" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:52:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:52:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:52:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:04 user nova-compute[75354]: INFO nova.compute.manager [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Detaching volume d823b503-c055-4291-9caa-bc167a3cdb21
Nov 14 06:53:04 user nova-compute[75354]: INFO nova.virt.block_device [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Attempting to driver detach volume d823b503-c055-4291-9caa-bc167a3cdb21 from mountpoint /dev/vdb
Nov 14 06:53:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Attempting to detach device vdb from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:53:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:53:04 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:53:04 user nova-compute[75354]:   <source dev="/dev/sdf"/>
Nov 14 06:53:04 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:53:04 user nova-compute[75354]:   <serial>d823b503-c055-4291-9caa-bc167a3cdb21</serial>
Nov 14 06:53:04 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:53:04 user nova-compute[75354]: </disk>
Nov 14 06:53:04 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:53:04 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Successfully detached device vdb from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the persistent domain config.
Nov 14 06:53:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:53:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:53:04 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:53:04 user nova-compute[75354]:   <source dev="/dev/sdf"/>
Nov 14 06:53:04 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:53:04 user nova-compute[75354]:   <serial>d823b503-c055-4291-9caa-bc167a3cdb21</serial>
Nov 14 06:53:04 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:53:04 user nova-compute[75354]: </disk>
Nov 14 06:53:04 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:53:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:53:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:10 user nova-compute[75354]: INFO nova.compute.manager [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Terminating instance
Nov 14 06:53:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-e11d1da2-8566-4eba-9c4d-5003deaaca6e req-8dbbfe98-b5cc-41ba-883c-5f1706c5e9ac service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-vif-unplugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e11d1da2-8566-4eba-9c4d-5003deaaca6e req-8dbbfe98-b5cc-41ba-883c-5f1706c5e9ac service nova] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e11d1da2-8566-4eba-9c4d-5003deaaca6e req-8dbbfe98-b5cc-41ba-883c-5f1706c5e9ac service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e11d1da2-8566-4eba-9c4d-5003deaaca6e req-8dbbfe98-b5cc-41ba-883c-5f1706c5e9ac service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-e11d1da2-8566-4eba-9c4d-5003deaaca6e req-8dbbfe98-b5cc-41ba-883c-5f1706c5e9ac service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] No waiting events found dispatching network-vif-unplugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-e11d1da2-8566-4eba-9c4d-5003deaaca6e req-8dbbfe98-b5cc-41ba-883c-5f1706c5e9ac service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-vif-unplugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Instance destroyed successfully.
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'resources' on Instance uuid 6f9d03ba-4080-4c18-a998-2d0bed6fcb82 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-170344645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-170344645',id=30,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-0r1hu0ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:45:45Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=6f9d03ba-4080-4c18-a998-2d0bed6fcb82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "address": "fa:16:3e:15:39:78", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46df7cd5-e4", "ovs_interfaceid": "46df7cd5-e452-48c7-8122-48ff4064f5a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG os_vif [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46df7cd5-e4, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ecc40d7-c290-425a-a2de-5d5d4fed7b42) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:11 user nova-compute[75354]: INFO os_vif [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:39:78,bridge_name='br-int',has_traffic_filtering=True,id=46df7cd5-e452-48c7-8122-48ff4064f5a1,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46df7cd5-e4')
Nov 14 06:53:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Deleting instance files /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82_del
Nov 14 06:53:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Deletion of /opt/stack/data/nova/instances/6f9d03ba-4080-4c18-a998-2d0bed6fcb82_del complete
Nov 14 06:53:11 user nova-compute[75354]: INFO nova.compute.manager [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 06:53:11 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:53:11 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Took 0.51 seconds to deallocate network for instance.
Nov 14 06:53:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-4f42ca5b-bc9a-44a8-b93d-cc26b07d1154 req-29c2c1b2-d4aa-4005-8b69-fe8daf1d831d service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-vif-deleted-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:12 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:53:12 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:53:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:12 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Deleted allocations for instance 6f9d03ba-4080-4c18-a998-2d0bed6fcb82
Nov 14 06:53:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-89a0f395-ad69-4268-8525-f08082c85d52 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.739s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-598b055c-5771-4be8-a35d-4ee9796d9c78 req-6fed6a83-f2fb-4c06-8ab8-14b411d60c6c service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received event network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:53:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-598b055c-5771-4be8-a35d-4ee9796d9c78 req-6fed6a83-f2fb-4c06-8ab8-14b411d60c6c service nova] Acquiring lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-598b055c-5771-4be8-a35d-4ee9796d9c78 req-6fed6a83-f2fb-4c06-8ab8-14b411d60c6c service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-598b055c-5771-4be8-a35d-4ee9796d9c78 req-6fed6a83-f2fb-4c06-8ab8-14b411d60c6c service nova] Lock "6f9d03ba-4080-4c18-a998-2d0bed6fcb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-598b055c-5771-4be8-a35d-4ee9796d9c78 req-6fed6a83-f2fb-4c06-8ab8-14b411d60c6c service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] No waiting events found dispatching network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:53:13 user nova-compute[75354]: WARNING nova.compute.manager [req-598b055c-5771-4be8-a35d-4ee9796d9c78 req-6fed6a83-f2fb-4c06-8ab8-14b411d60c6c service nova] [instance: 6f9d03ba-4080-4c18-a998-2d0bed6fcb82] Received unexpected event network-vif-plugged-46df7cd5-e452-48c7-8122-48ff4064f5a1 for instance with vm_state deleted and task_state None.
Nov 14 06:53:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:53:25 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc is timed out.
Nov 14 06:53:25 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Successfully detached device vdb from instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc from the live domain config.
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SivKQAyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:53:25 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:25 user nova-compute[75354]: INFO nova.compute.manager [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Detaching volume a45d81f6-b8fb-414c-b0f5-5c3e4be133a9
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7090e41-aace-4411-ac05-4e876f6cf5cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:53:25 user nova-compute[75354]: No targets found.
Nov 14 06:53:25 user nova-compute[75354]: iSNS:
Nov 14 06:53:25 user nova-compute[75354]: No targets found.
Nov 14 06:53:25 user nova-compute[75354]: STATIC:
Nov 14 06:53:25 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:53:25 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:25 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:25 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21
Nov 14 06:53:25 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:25 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:25 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:53:25 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:25 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:25 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9
Nov 14 06:53:25 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:25 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:25 user nova-compute[75354]: FIRMWARE:
Nov 14 06:53:25 user nova-compute[75354]: No targets found.
Nov 14 06:53:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:53:25 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:53:25 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bae899-1410-49f4-973d-9810ea4462e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de125357-ca49-4e18-8033-8865158892be]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 (non-flash)
Nov 14 06:53:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074467a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21'): ({'sdf'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Removing single pathed devices sdf {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: INFO nova.virt.block_device [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Attempting to driver detach volume a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 from mountpoint /dev/vdb
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Attempting to detach device vdb from instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:53:25 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:53:25 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:53:25 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:53:25 user nova-compute[75354]:   <serial>a45d81f6-b8fb-414c-b0f5-5c3e4be133a9</serial>
Nov 14 06:53:25 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:53:25 user nova-compute[75354]: </disk>
Nov 14 06:53:25 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22f2b2-81c8-443e-a9bf-638cb3fab5ef]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully detached device vdb from instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 from the persistent domain config.
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:53:25 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:53:25 user nova-compute[75354]:   <source dev="/dev/sde"/>
Nov 14 06:53:25 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:53:25 user nova-compute[75354]:   <serial>a45d81f6-b8fb-414c-b0f5-5c3e4be133a9</serial>
Nov 14 06:53:25 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:53:25 user nova-compute[75354]: </disk>
Nov 14 06:53:25 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5180daa1-1eb4-47a6-9f9f-0425833683d8]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Flushing IO for device /dev/sdf {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3c03ec-bd0c-4eff-bb26-8b9ce0ced45b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce174d4-0d29-4584-84b4-d3043b83a4d5]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] SCSI volumes sdf have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30944d50-f1b9-4a66-8d96-ff7300002f69]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a52402-5b91-4fd6-88bc-317be7bb1f84]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260]
Nov 14 06:53:25 user nova-compute[75354]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21, portal: 172.16.0.220,3260] successful.
Nov 14 06:53:25 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d823b503-c055-4291-9caa-bc167a3cdb21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781ca36-0c0f-4734-8c6e-f27f4bb7a1e5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] <== disconnect_volume: return (301ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:53:25 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:53:26 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'flavor' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:53:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bdbc8270-b818-459d-8868-376ed53c5334 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.609s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:53:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:53:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:44 user nova-compute[75354]: INFO nova.compute.manager [None req-4dde54d4-ca64-4a61-8398-2a9cd0f81d32 tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Get console output
Nov 14 06:53:44 user nova-compute[75354]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 06:53:45 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 is timed out.
Nov 14 06:53:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully detached device vdb from instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 from the live domain config.
Nov 14 06:53:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvDoIbsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:53:45 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326e66a-51cf-433a-a713-bd4475d68241]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:53:45 user nova-compute[75354]: No targets found.
Nov 14 06:53:45 user nova-compute[75354]: iSNS:
Nov 14 06:53:45 user nova-compute[75354]: No targets found.
Nov 14 06:53:45 user nova-compute[75354]: STATIC:
Nov 14 06:53:45 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:53:45 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:45 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:45 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:53:45 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:45 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:45 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9
Nov 14 06:53:45 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:53:45 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:53:45 user nova-compute[75354]: FIRMWARE:
Nov 14 06:53:45 user nova-compute[75354]: No targets found.
Nov 14 06:53:45 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:53:45 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:53:45 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[538f6897-724f-4501-b66d-4a91218dd945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79fecc6-3655-42f2-9584-f60c791dbb42]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:53:45 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:53:45 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:53:45 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:53:45 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:53:45 user nova-compute[75354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 (non-flash)
Nov 14 06:53:45 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074225cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9'): ({'sde'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Removing single pathed devices sde {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47bf2c4-886c-41d1-969a-cfef133bc748]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[503601fa-b113-484d-8495-518bddb7538a]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flushing IO for device /dev/sde {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ffa0f5-a5c5-4fdf-b2d0-672817ad889c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be7a565-8a65-4668-aeea-380e44812084]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] SCSI volumes sde have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:53:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9ad03-fad9-419d-97d8-0b8e35ba04a9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985f265-4e11-4760-91a0-6c8f53df6b84]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260]
Nov 14 06:53:46 user nova-compute[75354]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9, portal: 172.16.0.220,3260] successful.
Nov 14 06:53:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a45d81f6-b8fb-414c-b0f5-5c3e4be133a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e840ad7-5e13-49e5-8b61-a8f5ff01d633]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== disconnect_volume: return (308ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:53:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-088d6ace-7407-4229-8c75-6aef2a5a2282 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:47 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:53:49 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:53:50 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:53:50 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=25.186355590820312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:53:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:55 user nova-compute[75354]: INFO nova.compute.manager [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Terminating instance
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-2774f886-c150-4950-b291-cf898d582510 req-4633c22c-e5f9-4c12-9bb8-0c4b3a0dc692 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-vif-unplugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2774f886-c150-4950-b291-cf898d582510 req-4633c22c-e5f9-4c12-9bb8-0c4b3a0dc692 service nova] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2774f886-c150-4950-b291-cf898d582510 req-4633c22c-e5f9-4c12-9bb8-0c4b3a0dc692 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2774f886-c150-4950-b291-cf898d582510 req-4633c22c-e5f9-4c12-9bb8-0c4b3a0dc692 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-2774f886-c150-4950-b291-cf898d582510 req-4633c22c-e5f9-4c12-9bb8-0c4b3a0dc692 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] No waiting events found dispatching network-vif-unplugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-2774f886-c150-4950-b291-cf898d582510 req-4633c22c-e5f9-4c12-9bb8-0c4b3a0dc692 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-vif-unplugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:53:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Instance destroyed successfully.
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lazy-loading 'resources' on Instance uuid 119d8d28-91b2-42ca-9a68-8e7b81a965fc {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-486734701',display_name='tempest-TestServerVolumeAttachmentScenario-server-486734701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-486734701',id=35,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL3AAxs5HTOjdhgpgOr+MwsqoDoJ+BHsBn4NP8l7uqzg8YvRqUYeK6us6gnghEa5yXzHdwLX+K81DShI++VkRCVZmQ6dKmsIkS+55NblqfI/Q45lj8waJSIcBIORXqu/Q==',key_name='tempest-keypair-333943190',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aee1666dc694eb982ae85f399d1acda',ramdisk_id='',reservation_id='r-g9ydxcka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-974435090',owner_user_name='tempest-TestServerVolumeAttachmentScenario-974435090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='044d2b39ef8949daa9f883e35b8360eb',uuid=119d8d28-91b2-42ca-9a68-8e7b81a965fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Converting VIF {"id": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "address": "fa:16:3e:87:34:e3", "network": {"id": "241b5211-7b2e-4c31-927b-1cfc51ecdfa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-293161519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aee1666dc694eb982ae85f399d1acda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb90c7c6-b5", "ovs_interfaceid": "fb90c7c6-b5af-4e33-adda-6c6330369dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG os_vif [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb90c7c6-b5, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50dea12b-4ab5-45b5-b681-8dce9febebce) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:53:55 user nova-compute[75354]: INFO os_vif [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=fb90c7c6-b5af-4e33-adda-6c6330369dc5,network=Network(241b5211-7b2e-4c31-927b-1cfc51ecdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb90c7c6-b5')
Nov 14 06:53:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Deleting instance files /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc_del
Nov 14 06:53:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Deletion of /opt/stack/data/nova/instances/119d8d28-91b2-42ca-9a68-8e7b81a965fc_del complete
Nov 14 06:53:55 user nova-compute[75354]: INFO nova.compute.manager [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 06:53:55 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:53:55 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:53:56 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Took 0.64 seconds to deallocate network for instance.
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-6236f200-acec-4a50-beb3-54e871048ba8 req-f2b0b8e6-abf1-4850-960a-c378f7fa0b4b service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-vif-deleted-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:53:56 user nova-compute[75354]: INFO nova.compute.manager [req-6236f200-acec-4a50-beb3-54e871048ba8 req-f2b0b8e6-abf1-4850-960a-c378f7fa0b4b service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Neutron deleted interface fb90c7c6-b5af-4e33-adda-6c6330369dc5; detaching it from the instance and deleting it from the info cache
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-6236f200-acec-4a50-beb3-54e871048ba8 req-f2b0b8e6-abf1-4850-960a-c378f7fa0b4b service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-6236f200-acec-4a50-beb3-54e871048ba8 req-f2b0b8e6-abf1-4850-960a-c378f7fa0b4b service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Detach interface failed, port_id=fb90c7c6-b5af-4e33-adda-6c6330369dc5, reason: Instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:56 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Deleted allocations for instance 119d8d28-91b2-42ca-9a68-8e7b81a965fc
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [{"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-81afb686-fa45-43a2-a45a-1dbe0c7fecc0" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:53:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-75547085-0f08-4a9e-84a2-604445aad665 tempest-TestServerVolumeAttachmentScenario-974435090 tempest-TestServerVolumeAttachmentScenario-974435090-project-member] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:53:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-bacddd7c-36f8-4c0b-8802-cb56a4553aea req-aec33f7a-8366-4b71-9a9b-9272c163e7f9 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received event network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:53:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bacddd7c-36f8-4c0b-8802-cb56a4553aea req-aec33f7a-8366-4b71-9a9b-9272c163e7f9 service nova] Acquiring lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:53:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bacddd7c-36f8-4c0b-8802-cb56a4553aea req-aec33f7a-8366-4b71-9a9b-9272c163e7f9 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:53:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bacddd7c-36f8-4c0b-8802-cb56a4553aea req-aec33f7a-8366-4b71-9a9b-9272c163e7f9 service nova] Lock "119d8d28-91b2-42ca-9a68-8e7b81a965fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:53:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-bacddd7c-36f8-4c0b-8802-cb56a4553aea req-aec33f7a-8366-4b71-9a9b-9272c163e7f9 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] No waiting events found dispatching network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:53:57 user nova-compute[75354]: WARNING nova.compute.manager [req-bacddd7c-36f8-4c0b-8802-cb56a4553aea req-aec33f7a-8366-4b71-9a9b-9272c163e7f9 service nova] [instance: 119d8d28-91b2-42ca-9a68-8e7b81a965fc] Received unexpected event network-vif-plugged-fb90c7c6-b5af-4e33-adda-6c6330369dc5 for instance with vm_state deleted and task_state None.
Nov 14 06:53:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:01 user nova-compute[75354]: INFO nova.compute.manager [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Terminating instance
Nov 14 06:54:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-36af8ce4-d35f-4c85-bc77-4a831685d578 req-fe69177e-063f-46f1-b015-9ca81b75c252 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-36af8ce4-d35f-4c85-bc77-4a831685d578 req-fe69177e-063f-46f1-b015-9ca81b75c252 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-36af8ce4-d35f-4c85-bc77-4a831685d578 req-fe69177e-063f-46f1-b015-9ca81b75c252 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-36af8ce4-d35f-4c85-bc77-4a831685d578 req-fe69177e-063f-46f1-b015-9ca81b75c252 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-36af8ce4-d35f-4c85-bc77-4a831685d578 req-fe69177e-063f-46f1-b015-9ca81b75c252 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-36af8ce4-d35f-4c85-bc77-4a831685d578 req-fe69177e-063f-46f1-b015-9ca81b75c252 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-unplugged-155db473-e304-43ef-8f72-a416833af65a for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Instance destroyed successfully.
Nov 14 06:54:01 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'resources' on Instance uuid 9fa44e1b-6893-43f1-a435-3ef2fc914a1d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740472689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740472689',id=21,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-v7lgv8ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:42:01Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=9fa44e1b-6893-43f1-a435-3ef2fc914a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "155db473-e304-43ef-8f72-a416833af65a", "address": "fa:16:3e:5e:02:f4", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap155db473-e3", "ovs_interfaceid": "155db473-e304-43ef-8f72-a416833af65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_vif [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap155db473-e3, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b1713fd-fef2-4cf7-8e5b-e2fc807701bf) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:02 user nova-compute[75354]: INFO os_vif [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:02:f4,bridge_name='br-int',has_traffic_filtering=True,id=155db473-e304-43ef-8f72-a416833af65a,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155db473-e3')
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDBTSbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:54:02 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c9897d-be4d-4227-88cf-827e6b1d89da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:54:02 user nova-compute[75354]: No targets found.
Nov 14 06:54:02 user nova-compute[75354]: iSNS:
Nov 14 06:54:02 user nova-compute[75354]: No targets found.
Nov 14 06:54:02 user nova-compute[75354]: STATIC:
Nov 14 06:54:02 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0
Nov 14 06:54:02 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:54:02 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:54:02 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:54:02 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:54:02 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:54:02 user nova-compute[75354]: FIRMWARE:
Nov 14 06:54:02 user nova-compute[75354]: No targets found.
Nov 14 06:54:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:54:02 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:54:02 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaf3785-71e7-405c-a420-cb6a419863ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[834b2fa4-541f-4f9a-853a-141a8a3c589a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:54:02 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:54:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 (non-flash)
Nov 14 06:54:02 user nova-compute[75354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:54:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80742268c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[780cb1d1-36a6-43c2-b105-5a8de9dee3d0]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec506353-3e5a-4720-ad43-cd4c152dc567]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0ee7c0-cdc4-45b9-91ee-1a2dc7aac50b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f608d3fa-629a-488d-bd5e-872afed2b222]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9242a3-75c3-4c95-ba3a-aec80763908f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a871a7-aa6f-470c-b04f-926a026ab20d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260]
Nov 14 06:54:02 user nova-compute[75354]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0, portal: 172.16.0.220,3260] successful.
Nov 14 06:54:02 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ebef2e-f32d-4d78-bef2-473e138ca7a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e0b209-4119-43eb-9d86-f9eacc635517]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] <== disconnect_volume: return (286ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:54:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Deleting instance files /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d_del
Nov 14 06:54:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Deletion of /opt/stack/data/nova/instances/9fa44e1b-6893-43f1-a435-3ef2fc914a1d_del complete
Nov 14 06:54:02 user nova-compute[75354]: INFO nova.compute.manager [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 14 06:54:02 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:54:02 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:54:02 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Took 0.47 seconds to deallocate network for instance.
Nov 14 06:54:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] Acquiring lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] No waiting events found dispatching network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:03 user nova-compute[75354]: WARNING nova.compute.manager [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received unexpected event network-vif-plugged-155db473-e304-43ef-8f72-a416833af65a for instance with vm_state active and task_state deleting.
Nov 14 06:54:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-37301981-c7da-43b2-a58f-6ec06f60c8b6 req-dd0be3d6-5193-477a-b8d1-79e4ce81c984 service nova] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Received event network-vif-deleted-155db473-e304-43ef-8f72-a416833af65a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:03 user nova-compute[75354]: INFO nova.compute.manager [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 9fa44e1b-6893-43f1-a435-3ef2fc914a1d] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:03 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Deleted allocations for instance 9fa44e1b-6893-43f1-a435-3ef2fc914a1d
Nov 14 06:54:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e43b8b84-10d0-4e37-9f1b-d7c356dcdd37 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "9fa44e1b-6893-43f1-a435-3ef2fc914a1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:15 user nova-compute[75354]: INFO nova.compute.manager [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Terminating instance
Nov 14 06:54:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-f0ecc2a3-49a9-4dd9-ab70-295a02c6549b req-376594bd-d091-40c9-ba9f-8953492371ae service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-vif-unplugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f0ecc2a3-49a9-4dd9-ab70-295a02c6549b req-376594bd-d091-40c9-ba9f-8953492371ae service nova] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f0ecc2a3-49a9-4dd9-ab70-295a02c6549b req-376594bd-d091-40c9-ba9f-8953492371ae service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f0ecc2a3-49a9-4dd9-ab70-295a02c6549b req-376594bd-d091-40c9-ba9f-8953492371ae service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-f0ecc2a3-49a9-4dd9-ab70-295a02c6549b req-376594bd-d091-40c9-ba9f-8953492371ae service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] No waiting events found dispatching network-vif-unplugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-f0ecc2a3-49a9-4dd9-ab70-295a02c6549b req-376594bd-d091-40c9-ba9f-8953492371ae service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-vif-unplugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:54:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Instance destroyed successfully.
Nov 14 06:54:16 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'resources' on Instance uuid b2d4f9ab-0ae0-46cd-8059-1ac1d9363562 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-854765821',display_name='tempest-AttachVolumeNegativeTest-server-854765821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-854765821',id=34,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSS6NSLgoayr6G+2oyhE+48yK1DcFPxlhzgZCl3YU2eBMPngWz8Kz+xhiuGz0f4zD9deP04XH1aJkF3yEfxGzpraCp7deYqGMaO3HZtimCjqxFCUNm58PZxepvc4i3Nxw==',key_name='tempest-keypair-1015509865',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-nzbgrvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=b2d4f9ab-0ae0-46cd-8059-1ac1d9363562,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "address": "fa:16:3e:ca:97:b3", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb01e40cb-f5", "ovs_interfaceid": "b01e40cb-f5c4-4b5c-86fa-840399a81d2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG os_vif [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb01e40cb-f5, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d11c9f32-e47e-4412-bf37-fb8e08926857) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:16 user nova-compute[75354]: INFO os_vif [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=b01e40cb-f5c4-4b5c-86fa-840399a81d2a,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb01e40cb-f5')
Nov 14 06:54:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Deleting instance files /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562_del
Nov 14 06:54:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Deletion of /opt/stack/data/nova/instances/b2d4f9ab-0ae0-46cd-8059-1ac1d9363562_del complete
Nov 14 06:54:16 user nova-compute[75354]: INFO nova.compute.manager [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 06:54:16 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:54:16 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:54:17 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Took 0.71 seconds to deallocate network for instance.
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:17 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Deleted allocations for instance b2d4f9ab-0ae0-46cd-8059-1ac1d9363562
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1b8330dc-4241-4413-8f5f-725d1e119c23 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] Acquiring lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] Lock "b2d4f9ab-0ae0-46cd-8059-1ac1d9363562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] No waiting events found dispatching network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:17 user nova-compute[75354]: WARNING nova.compute.manager [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received unexpected event network-vif-plugged-b01e40cb-f5c4-4b5c-86fa-840399a81d2a for instance with vm_state deleted and task_state None.
Nov 14 06:54:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4cfa2695-436c-4e7e-982c-9b7556fdb1ae req-f03176c1-1d11-4f76-9771-b9a202238368 service nova] [instance: b2d4f9ab-0ae0-46cd-8059-1ac1d9363562] Received event network-vif-deleted-b01e40cb-f5c4-4b5c-86fa-840399a81d2a {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:54:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:54:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:54:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:45 user nova-compute[75354]: INFO nova.compute.manager [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Terminating instance
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-0f4caee0-9810-439d-a46e-0cc58c56ed8d req-6ae85670-c132-42e5-81b5-89d35bc142b5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0f4caee0-9810-439d-a46e-0cc58c56ed8d req-6ae85670-c132-42e5-81b5-89d35bc142b5 service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0f4caee0-9810-439d-a46e-0cc58c56ed8d req-6ae85670-c132-42e5-81b5-89d35bc142b5 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0f4caee0-9810-439d-a46e-0cc58c56ed8d req-6ae85670-c132-42e5-81b5-89d35bc142b5 service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-0f4caee0-9810-439d-a46e-0cc58c56ed8d req-6ae85670-c132-42e5-81b5-89d35bc142b5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-0f4caee0-9810-439d-a46e-0cc58c56ed8d req-6ae85670-c132-42e5-81b5-89d35bc142b5 service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-unplugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Instance destroyed successfully.
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'resources' on Instance uuid 81afb686-fa45-43a2-a45a-1dbe0c7fecc0 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659409402',display_name='tempest-ServerActionsTestOtherA-server-1659409402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659409402',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-w8sfr6w5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=81afb686-fa45-43a2-a45a-1dbe0c7fecc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "address": "fa:16:3e:af:60:04", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9d1ffc-c4", "ovs_interfaceid": "ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG os_vif [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce9d1ffc-c4, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=328a1fec-e16f-4722-89a1-2ae7cc8365de) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:45 user nova-compute[75354]: INFO os_vif [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:60:04,bridge_name='br-int',has_traffic_filtering=True,id=ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9d1ffc-c4')
Nov 14 06:54:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VncmZqYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:54:45 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:54:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:54:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db7790-8925-43ab-802f-94a7f84b6f44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:54:46 user nova-compute[75354]: No targets found.
Nov 14 06:54:46 user nova-compute[75354]: iSNS:
Nov 14 06:54:46 user nova-compute[75354]: No targets found.
Nov 14 06:54:46 user nova-compute[75354]: STATIC:
Nov 14 06:54:46 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2
Nov 14 06:54:46 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:54:46 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:54:46 user nova-compute[75354]: FIRMWARE:
Nov 14 06:54:46 user nova-compute[75354]: No targets found.
Nov 14 06:54:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:54:46 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:54:46 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477ef08-ff80-4458-b845-a3f3a04632cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a961de36-77a1-49b9-8dbf-34aff963854a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:54:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 (non-flash)
Nov 14 06:54:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074477d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4901bd11-6964-4e49-a6a2-49f7b698d89f]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843fb0a-b0a3-4b61-b43d-bd532ba873c2]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa58629-1460-4c58-b458-d9323a8457a7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de09273a-2bf6-425f-bd4f-e6c4d6a0ed00]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6202680e-527fc693e57f2922', '/dev/disk/by-id/scsi-23532376663363933', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6202680e') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7b72b8-455b-4f2f-af64-681b72fcb688]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e1a52-d1f2-4497-bd1c-71c6ae70d333]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdfd755-9e28-4932-961d-980bdc1c5348]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260]
Nov 14 06:54:46 user nova-compute[75354]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2, portal: 172.16.0.220,3260] successful.
Nov 14 06:54:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4974fc-256f-40f6-80d8-e780ace312e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d03ade6-b127-4a6d-b0e7-d2bfd3f4a554]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] <== disconnect_volume: return (321ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:54:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Deleting instance files /opt/stack/data/nova/instances/81afb686-fa45-43a2-a45a-1dbe0c7fecc0_del
Nov 14 06:54:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Deletion of /opt/stack/data/nova/instances/81afb686-fa45-43a2-a45a-1dbe0c7fecc0_del complete
Nov 14 06:54:46 user nova-compute[75354]: INFO nova.compute.manager [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 06:54:46 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:54:46 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:54:47 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:54:47 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Took 0.72 seconds to deallocate network for instance.
Nov 14 06:54:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-e7ed397e-cb96-4d14-9ba2-94cdbe787004 req-eba02dbb-0fd1-4e73-807a-635623c5eebe service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-deleted-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-f25f6342-17f7-4e90-8ec7-4051e85a8c5c req-567ddd5e-1203-4407-8556-b1d89a89a4ad service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f25f6342-17f7-4e90-8ec7-4051e85a8c5c req-567ddd5e-1203-4407-8556-b1d89a89a4ad service nova] Acquiring lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f25f6342-17f7-4e90-8ec7-4051e85a8c5c req-567ddd5e-1203-4407-8556-b1d89a89a4ad service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f25f6342-17f7-4e90-8ec7-4051e85a8c5c req-567ddd5e-1203-4407-8556-b1d89a89a4ad service nova] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-f25f6342-17f7-4e90-8ec7-4051e85a8c5c req-567ddd5e-1203-4407-8556-b1d89a89a4ad service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] No waiting events found dispatching network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:47 user nova-compute[75354]: WARNING nova.compute.manager [req-f25f6342-17f7-4e90-8ec7-4051e85a8c5c req-567ddd5e-1203-4407-8556-b1d89a89a4ad service nova] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Received unexpected event network-vif-plugged-ce9d1ffc-c4fb-4a59-86c5-d4da654fec2e for instance with vm_state active and task_state deleting.
Nov 14 06:54:47 user nova-compute[75354]: INFO nova.compute.manager [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 06:54:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 81afb686-fa45-43a2-a45a-1dbe0c7fecc0] Deleting volume: fe4974fc-256f-40f6-80d8-e780ace312e2 {{(pid=75354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 06:54:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:48 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:54:48 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:54:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:48 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Deleted allocations for instance 81afb686-fa45-43a2-a45a-1dbe0c7fecc0
Nov 14 06:54:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cf27900-3157-4b6c-b526-ed08a6f727fd tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "81afb686-fa45-43a2-a45a-1dbe0c7fecc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:54:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:51 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:54:51 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.232906341552734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 2b2f22af-1a41-4747-9a16-561e260d5f63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:51 user nova-compute[75354]: INFO nova.compute.manager [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Terminating instance
Nov 14 06:54:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:54:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-b68908e9-6204-4c24-8f70-a7189dd5abd9 req-70b98374-0545-49ff-b093-013dc6662779 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-vif-unplugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b68908e9-6204-4c24-8f70-a7189dd5abd9 req-70b98374-0545-49ff-b093-013dc6662779 service nova] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b68908e9-6204-4c24-8f70-a7189dd5abd9 req-70b98374-0545-49ff-b093-013dc6662779 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b68908e9-6204-4c24-8f70-a7189dd5abd9 req-70b98374-0545-49ff-b093-013dc6662779 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-b68908e9-6204-4c24-8f70-a7189dd5abd9 req-70b98374-0545-49ff-b093-013dc6662779 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] No waiting events found dispatching network-vif-unplugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-b68908e9-6204-4c24-8f70-a7189dd5abd9 req-70b98374-0545-49ff-b093-013dc6662779 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-vif-unplugged-96458fbf-4165-4a69-92eb-c806810ef7e8 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:54:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Instance destroyed successfully.
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lazy-loading 'resources' on Instance uuid 2b2f22af-1a41-4747-9a16-561e260d5f63 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771886086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771886086',id=16,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:34:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0fdd525e8a49aeac22892962d8b14e',ramdisk_id='',reservation_id='r-sgebyxq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:36:22Z,user_data=None,user_id='2dfc31b05a2848128a837f170ac63b93',uuid=2b2f22af-1a41-4747-9a16-561e260d5f63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converting VIF {"id": "96458fbf-4165-4a69-92eb-c806810ef7e8", "address": "fa:16:3e:d9:66:91", "network": {"id": "142a08ce-c39b-4cab-8b44-0025e8284db7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-336281893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e0fdd525e8a49aeac22892962d8b14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96458fbf-41", "ovs_interfaceid": "96458fbf-4165-4a69-92eb-c806810ef7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG os_vif [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96458fbf-41, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=585d7212-a53c-4f94-bc4a-6fe679ad5ed1) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:54:52 user nova-compute[75354]: INFO os_vif [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:66:91,bridge_name='br-int',has_traffic_filtering=True,id=96458fbf-4165-4a69-92eb-c806810ef7e8,network=Network(142a08ce-c39b-4cab-8b44-0025e8284db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96458fbf-41')
Nov 14 06:54:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Deleting instance files /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63_del
Nov 14 06:54:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Deletion of /opt/stack/data/nova/instances/2b2f22af-1a41-4747-9a16-561e260d5f63_del complete
Nov 14 06:54:52 user nova-compute[75354]: INFO nova.compute.manager [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 06:54:52 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:54:52 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:54:53 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Took 0.56 seconds to deallocate network for instance.
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:54:53 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Deleted allocations for instance 2b2f22af-1a41-4747-9a16-561e260d5f63
Nov 14 06:54:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-00d6a0cc-d00c-4996-8d93-c18360201955 tempest-ServerBootFromVolumeStableRescueTest-1883221150 tempest-ServerBootFromVolumeStableRescueTest-1883221150-project-member] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] Acquiring lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:54:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:54:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] Lock "2b2f22af-1a41-4747-9a16-561e260d5f63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:54:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] No waiting events found dispatching network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:54:54 user nova-compute[75354]: WARNING nova.compute.manager [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received unexpected event network-vif-plugged-96458fbf-4165-4a69-92eb-c806810ef7e8 for instance with vm_state deleted and task_state None.
Nov 14 06:54:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-a535f33c-8d02-42a9-9741-24eedf7f46a0 req-e9fcf92c-e6ad-4bd3-bf75-2d9f78a7c588 service nova] [instance: 2b2f22af-1a41-4747-9a16-561e260d5f63] Received event network-vif-deleted-96458fbf-4165-4a69-92eb-c806810ef7e8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:54:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:54:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 06:54:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:54:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:54:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:55:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:55:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:55:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:55:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:55:09 user nova-compute[75354]: INFO nova.compute.claims [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Claim successful on node user
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.network.neutron [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:55:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:55:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Creating image(s)
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "/opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG nova.policy [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a633fa123bb74524b360106dc68456b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930e51c7a6574779985bacd62c89cdf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.177s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk 1073741824" returned: 0 in 0.056s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Successfully created port: 96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Cannot resize image /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Ensure instance console log exists: /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Successfully updated port: 96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquired lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-changed-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.compute.manager [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Refreshing instance network info cache due to event network-changed-96080eb7-9544-4613-8ed6-e11adc9562a9. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] Acquiring lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:55:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Releasing lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Instance network_info: |[{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] Acquired lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Refreshing network info cache for port 96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Start _get_guest_xml network_info=[{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:55:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:55:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-249862347',display_name='tempest-AttachVolumeNegativeTest-server-249862347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-249862347',id=37,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr8BS6qEC/mR2aNUfrz3PuYyuhyuGBdarPcePGaRLed2wLUlDL/M72NoN+cwUAo+w2GzNYR6MTBic1edlFwKGDcDfcj7ysGeYDuTA22EbcB1I7zuD/zRZvQmkan5vJ8Cg==',key_name='tempest-keypair-958532620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-ux5g9l37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=54f48ba8-3407-4cb9-8e6a-29c481f42a62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'pci_devices' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:55:11 user nova-compute[75354]:   <uuid>54f48ba8-3407-4cb9-8e6a-29c481f42a62</uuid>
Nov 14 06:55:11 user nova-compute[75354]:   <name>instance-00000025</name>
Nov 14 06:55:11 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:55:11 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:55:11 user nova-compute[75354]:   <metadata>
Nov 14 06:55:11 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:55:11 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:55:11 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-249862347</nova:name>
Nov 14 06:55:11 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:55:11</nova:creationTime>
Nov 14 06:55:11 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:55:11 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:55:11 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:55:11 user nova-compute[75354]:       <nova:owner>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:user uuid="a633fa123bb74524b360106dc68456b5">tempest-AttachVolumeNegativeTest-365177810-project-member</nova:user>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:project uuid="930e51c7a6574779985bacd62c89cdf6">tempest-AttachVolumeNegativeTest-365177810</nova:project>
Nov 14 06:55:11 user nova-compute[75354]:       </nova:owner>
Nov 14 06:55:11 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:55:11 user nova-compute[75354]:       <nova:ports>
Nov 14 06:55:11 user nova-compute[75354]:         <nova:port uuid="96080eb7-9544-4613-8ed6-e11adc9562a9">
Nov 14 06:55:11 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 06:55:11 user nova-compute[75354]:         </nova:port>
Nov 14 06:55:11 user nova-compute[75354]:       </nova:ports>
Nov 14 06:55:11 user nova-compute[75354]:     </nova:instance>
Nov 14 06:55:11 user nova-compute[75354]:   </metadata>
Nov 14 06:55:11 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:55:11 user nova-compute[75354]:     <system>
Nov 14 06:55:11 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:55:11 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:55:11 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:55:11 user nova-compute[75354]:       <entry name="serial">54f48ba8-3407-4cb9-8e6a-29c481f42a62</entry>
Nov 14 06:55:11 user nova-compute[75354]:       <entry name="uuid">54f48ba8-3407-4cb9-8e6a-29c481f42a62</entry>
Nov 14 06:55:11 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:55:11 user nova-compute[75354]:     </system>
Nov 14 06:55:11 user nova-compute[75354]:   </sysinfo>
Nov 14 06:55:11 user nova-compute[75354]:   <os>
Nov 14 06:55:11 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:55:11 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:55:11 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:55:11 user nova-compute[75354]:   </os>
Nov 14 06:55:11 user nova-compute[75354]:   <features>
Nov 14 06:55:11 user nova-compute[75354]:     <acpi/>
Nov 14 06:55:11 user nova-compute[75354]:     <apic/>
Nov 14 06:55:11 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:55:11 user nova-compute[75354]:   </features>
Nov 14 06:55:11 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:55:11 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:55:11 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:55:11 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:55:11 user nova-compute[75354]:   </clock>
Nov 14 06:55:11 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:55:11 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:55:11 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:55:11 user nova-compute[75354]:   </cpu>
Nov 14 06:55:11 user nova-compute[75354]:   <devices>
Nov 14 06:55:11 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:55:11 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:55:11 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk"/>
Nov 14 06:55:11 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:55:11 user nova-compute[75354]:     </disk>
Nov 14 06:55:11 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:55:11 user nova-compute[75354]:       <mac address="fa:16:3e:62:bb:52"/>
Nov 14 06:55:11 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:55:11 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:55:11 user nova-compute[75354]:       <target dev="tap96080eb7-95"/>
Nov 14 06:55:11 user nova-compute[75354]:     </interface>
Nov 14 06:55:11 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:55:11 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/console.log" append="off"/>
Nov 14 06:55:11 user nova-compute[75354]:     </serial>
Nov 14 06:55:11 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:55:11 user nova-compute[75354]:     <video>
Nov 14 06:55:11 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:55:11 user nova-compute[75354]:     </video>
Nov 14 06:55:11 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:55:11 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:55:11 user nova-compute[75354]:     </rng>
Nov 14 06:55:11 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:55:11 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:55:11 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:55:11 user nova-compute[75354]:     </memballoon>
Nov 14 06:55:11 user nova-compute[75354]:   </devices>
Nov 14 06:55:11 user nova-compute[75354]: </domain>
Nov 14 06:55:11 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-249862347',display_name='tempest-AttachVolumeNegativeTest-server-249862347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-249862347',id=37,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr8BS6qEC/mR2aNUfrz3PuYyuhyuGBdarPcePGaRLed2wLUlDL/M72NoN+cwUAo+w2GzNYR6MTBic1edlFwKGDcDfcj7ysGeYDuTA22EbcB1I7zuD/zRZvQmkan5vJ8Cg==',key_name='tempest-keypair-958532620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-ux5g9l37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=54f48ba8-3407-4cb9-8e6a-29c481f42a62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG os_vif [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f3b98b0-9916-574f-afd8-98eadf48a25d', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96080eb7-95, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96080eb7-95, col_values=(('qos', UUID('7a19b6f8-8edc-46cc-8f13-4c3a7f2333ee')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96080eb7-95, col_values=(('external_ids', {'iface-id': '96080eb7-9544-4613-8ed6-e11adc9562a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:bb:52', 'vm-uuid': '54f48ba8-3407-4cb9-8e6a-29c481f42a62'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:11 user nova-compute[75354]: INFO os_vif [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95')
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:62:bb:52, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updated VIF entry in instance network info cache for port 96080eb7-9544-4613-8ed6-e11adc9562a9. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:55:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-00f31bc3-9756-472a-8619-5c0f93d93e29 req-240e3b7f-04fd-4140-b222-8521ab85b15e service nova] Releasing lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:55:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:12 user nova-compute[75354]: DEBUG nova.compute.manager [req-64f250a2-8423-44b5-aa00-5a82dc07616e req-5b78a91d-9a17-491c-a6d5-f56470f3e1d2 service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-64f250a2-8423-44b5-aa00-5a82dc07616e req-5b78a91d-9a17-491c-a6d5-f56470f3e1d2 service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-64f250a2-8423-44b5-aa00-5a82dc07616e req-5b78a91d-9a17-491c-a6d5-f56470f3e1d2 service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-64f250a2-8423-44b5-aa00-5a82dc07616e req-5b78a91d-9a17-491c-a6d5-f56470f3e1d2 service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-64f250a2-8423-44b5-aa00-5a82dc07616e req-5b78a91d-9a17-491c-a6d5-f56470f3e1d2 service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:13 user nova-compute[75354]: WARNING nova.compute.manager [req-64f250a2-8423-44b5-aa00-5a82dc07616e req-5b78a91d-9a17-491c-a6d5-f56470f3e1d2 service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state building and task_state spawning.
Nov 14 06:55:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:55:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Instance spawned successfully.
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-cfe0ffeb-83ee-4d44-a86c-e34b37ad9921 req-a5ad5f9e-0ad1-4a8a-92d8-d1d2646da0d0 service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-cfe0ffeb-83ee-4d44-a86c-e34b37ad9921 req-a5ad5f9e-0ad1-4a8a-92d8-d1d2646da0d0 service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-cfe0ffeb-83ee-4d44-a86c-e34b37ad9921 req-a5ad5f9e-0ad1-4a8a-92d8-d1d2646da0d0 service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-cfe0ffeb-83ee-4d44-a86c-e34b37ad9921 req-a5ad5f9e-0ad1-4a8a-92d8-d1d2646da0d0 service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-cfe0ffeb-83ee-4d44-a86c-e34b37ad9921 req-a5ad5f9e-0ad1-4a8a-92d8-d1d2646da0d0 service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:15 user nova-compute[75354]: WARNING nova.compute.manager [req-cfe0ffeb-83ee-4d44-a86c-e34b37ad9921 req-a5ad5f9e-0ad1-4a8a-92d8-d1d2646da0d0 service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state building and task_state spawning.
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:55:15 user nova-compute[75354]: INFO nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 14 06:55:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:55:15 user nova-compute[75354]: INFO nova.compute.manager [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Took 6.28 seconds to build instance.
Nov 14 06:55:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-339b4cfa-0947-4168-99e1-761349fc6628 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.380s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:38 user nova-compute[75354]: INFO nova.compute.manager [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Terminating instance
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ea532c7-ec14-40c0-b5a2-c5653506970a req-10227927-c7f0-4913-8392-525d1daea942 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-unplugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ea532c7-ec14-40c0-b5a2-c5653506970a req-10227927-c7f0-4913-8392-525d1daea942 service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ea532c7-ec14-40c0-b5a2-c5653506970a req-10227927-c7f0-4913-8392-525d1daea942 service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ea532c7-ec14-40c0-b5a2-c5653506970a req-10227927-c7f0-4913-8392-525d1daea942 service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ea532c7-ec14-40c0-b5a2-c5653506970a req-10227927-c7f0-4913-8392-525d1daea942 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-unplugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ea532c7-ec14-40c0-b5a2-c5653506970a req-10227927-c7f0-4913-8392-525d1daea942 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-unplugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Instance destroyed successfully.
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lazy-loading 'resources' on Instance uuid 3e182ade-8d18-4fd0-a197-e4ea6d655e2d {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-391938631',display_name='tempest-ServerActionsTestOtherA-server-391938631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-391938631',id=20,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOACmtBw0vycV0XN2MbygYyzH71KyYYC+Ibx2y/f81wNJCcDyPjqZEdn5gksr2YvNTgYpIDFZuJdqfw9wssD49SN+rDQPoF/gE0iuZW9j7oZdPxA7O2FqiESGXw4bkAqQ==',key_name='tempest-keypair-1778964821',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85018ee44225437ab1d8b96c5fa4c408',ramdisk_id='',reservation_id='r-sc7p8526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-834998162',owner_user_name='tempest-ServerActionsTestOtherA-834998162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4616257fc4344844a8a7913673ae0a6a',uuid=3e182ade-8d18-4fd0-a197-e4ea6d655e2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converting VIF {"id": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "address": "fa:16:3e:66:4a:8e", "network": {"id": "8d02338c-0773-4b3e-b5a3-5d389c6cfd4c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-458060275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85018ee44225437ab1d8b96c5fa4c408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cd5c83-b5", "ovs_interfaceid": "a3cd5c83-b585-4d06-9990-c2d4e9d1b96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG os_vif [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3cd5c83-b5, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d77767c-66b8-4fc0-a22a-f5ff3f99e3cb) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: INFO os_vif [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=a3cd5c83-b585-4d06-9990-c2d4e9d1b96c,network=Network(8d02338c-0773-4b3e-b5a3-5d389c6cfd4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cd5c83-b5')
Nov 14 06:55:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Deleting instance files /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d_del
Nov 14 06:55:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Deletion of /opt/stack/data/nova/instances/3e182ade-8d18-4fd0-a197-e4ea6d655e2d_del complete
Nov 14 06:55:39 user nova-compute[75354]: INFO nova.compute.manager [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 14 06:55:39 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:55:39 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Took 0.50 seconds to deallocate network for instance.
Nov 14 06:55:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-58f49e34-b146-4338-9afc-2451ba9718a1 req-8987348e-9a05-489c-8d54-7d8c6e498dc7 service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-deleted-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:55:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:39 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Deleted allocations for instance 3e182ade-8d18-4fd0-a197-e4ea6d655e2d
Nov 14 06:55:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2974cdb7-e26f-4bcb-9d0c-334b8f04352d tempest-ServerActionsTestOtherA-834998162 tempest-ServerActionsTestOtherA-834998162-project-member] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.553s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:40 user nova-compute[75354]: WARNING nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received unexpected event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with vm_state deleted and task_state None.
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:40 user nova-compute[75354]: WARNING nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received unexpected event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with vm_state deleted and task_state None.
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:40 user nova-compute[75354]: WARNING nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received unexpected event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with vm_state deleted and task_state None.
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Acquiring lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] Lock "3e182ade-8d18-4fd0-a197-e4ea6d655e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] No waiting events found dispatching network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:55:40 user nova-compute[75354]: WARNING nova.compute.manager [req-6b058658-e937-4167-a952-1bce4f8ca938 req-f8e73380-a4ac-4e23-9d0d-03923942459d service nova] [instance: 3e182ade-8d18-4fd0-a197-e4ea6d655e2d] Received unexpected event network-vif-plugged-a3cd5c83-b585-4d06-9990-c2d4e9d1b96c for instance with vm_state deleted and task_state None.
Nov 14 06:55:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:49 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:55:50 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:55:50 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:55:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.354244232177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:55:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:55:51 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:55:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:55:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:55:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:55:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:55:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:55:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:55:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:55:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 06:56:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:02 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 06:56:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 06:56:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:56:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:56:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:56:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:56:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:56:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:56:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:56:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:56:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:56:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:56:29 user nova-compute[75354]: INFO nova.compute.claims [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Claim successful on node user
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.network.neutron [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:56:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:56:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.policy [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '682f4421b0de47a8a106621ff6c9ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83142058e2e4110b66f3067a0c0c1c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:56:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Creating image(s)
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "/opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "/opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk 1073741824" returned: 0 in 0.049s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Successfully created port: 784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Cannot resize image /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Ensure instance console log exists: /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Successfully updated port: 784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquired lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-changed-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Refreshing instance network info cache due to event network-changed-784cf525-e4a3-4ae2-9d34-4ea26539bffb. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] Acquiring lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updating instance_info_cache with network_info: [{"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Releasing lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Instance network_info: |[{"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] Acquired lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.network.neutron [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Refreshing network info cache for port 784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Start _get_guest_xml network_info=[{"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:56:31 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:56:31 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:56:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1882181244',display_name='tempest-VolumesActionsTest-instance-1882181244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1882181244',id=38,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a83142058e2e4110b66f3067a0c0c1c7',ramdisk_id='',reservation_id='r-ie56go0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-503809711',owner_user_name='tempest-VolumesActionsTest-503809711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:56:30Z,user_data=None,user_id='682f4421b0de47a8a106621ff6c9ce9d',uuid=bb4793ee-3d31-41fe-9e1b-3d8442caf23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Converting VIF {"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.objects.instance [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lazy-loading 'pci_devices' on Instance uuid bb4793ee-3d31-41fe-9e1b-3d8442caf23a {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:56:32 user nova-compute[75354]:   <uuid>bb4793ee-3d31-41fe-9e1b-3d8442caf23a</uuid>
Nov 14 06:56:32 user nova-compute[75354]:   <name>instance-00000026</name>
Nov 14 06:56:32 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:56:32 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:56:32 user nova-compute[75354]:   <metadata>
Nov 14 06:56:32 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:56:32 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:56:32 user nova-compute[75354]:       <nova:name>tempest-VolumesActionsTest-instance-1882181244</nova:name>
Nov 14 06:56:32 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:56:31</nova:creationTime>
Nov 14 06:56:32 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:56:32 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:56:32 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:56:32 user nova-compute[75354]:       <nova:owner>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:user uuid="682f4421b0de47a8a106621ff6c9ce9d">tempest-VolumesActionsTest-503809711-project-member</nova:user>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:project uuid="a83142058e2e4110b66f3067a0c0c1c7">tempest-VolumesActionsTest-503809711</nova:project>
Nov 14 06:56:32 user nova-compute[75354]:       </nova:owner>
Nov 14 06:56:32 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:56:32 user nova-compute[75354]:       <nova:ports>
Nov 14 06:56:32 user nova-compute[75354]:         <nova:port uuid="784cf525-e4a3-4ae2-9d34-4ea26539bffb">
Nov 14 06:56:32 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 06:56:32 user nova-compute[75354]:         </nova:port>
Nov 14 06:56:32 user nova-compute[75354]:       </nova:ports>
Nov 14 06:56:32 user nova-compute[75354]:     </nova:instance>
Nov 14 06:56:32 user nova-compute[75354]:   </metadata>
Nov 14 06:56:32 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:56:32 user nova-compute[75354]:     <system>
Nov 14 06:56:32 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:56:32 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:56:32 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:56:32 user nova-compute[75354]:       <entry name="serial">bb4793ee-3d31-41fe-9e1b-3d8442caf23a</entry>
Nov 14 06:56:32 user nova-compute[75354]:       <entry name="uuid">bb4793ee-3d31-41fe-9e1b-3d8442caf23a</entry>
Nov 14 06:56:32 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:56:32 user nova-compute[75354]:     </system>
Nov 14 06:56:32 user nova-compute[75354]:   </sysinfo>
Nov 14 06:56:32 user nova-compute[75354]:   <os>
Nov 14 06:56:32 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:56:32 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:56:32 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:56:32 user nova-compute[75354]:   </os>
Nov 14 06:56:32 user nova-compute[75354]:   <features>
Nov 14 06:56:32 user nova-compute[75354]:     <acpi/>
Nov 14 06:56:32 user nova-compute[75354]:     <apic/>
Nov 14 06:56:32 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:56:32 user nova-compute[75354]:   </features>
Nov 14 06:56:32 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:56:32 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:56:32 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:56:32 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:56:32 user nova-compute[75354]:   </clock>
Nov 14 06:56:32 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:56:32 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:56:32 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:56:32 user nova-compute[75354]:   </cpu>
Nov 14 06:56:32 user nova-compute[75354]:   <devices>
Nov 14 06:56:32 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:56:32 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:56:32 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk"/>
Nov 14 06:56:32 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:56:32 user nova-compute[75354]:     </disk>
Nov 14 06:56:32 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:56:32 user nova-compute[75354]:       <mac address="fa:16:3e:b0:6e:7c"/>
Nov 14 06:56:32 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:56:32 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:56:32 user nova-compute[75354]:       <target dev="tap784cf525-e4"/>
Nov 14 06:56:32 user nova-compute[75354]:     </interface>
Nov 14 06:56:32 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:56:32 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/console.log" append="off"/>
Nov 14 06:56:32 user nova-compute[75354]:     </serial>
Nov 14 06:56:32 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:56:32 user nova-compute[75354]:     <video>
Nov 14 06:56:32 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:56:32 user nova-compute[75354]:     </video>
Nov 14 06:56:32 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:56:32 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:56:32 user nova-compute[75354]:     </rng>
Nov 14 06:56:32 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:56:32 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:56:32 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:56:32 user nova-compute[75354]:     </memballoon>
Nov 14 06:56:32 user nova-compute[75354]:   </devices>
Nov 14 06:56:32 user nova-compute[75354]: </domain>
Nov 14 06:56:32 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1882181244',display_name='tempest-VolumesActionsTest-instance-1882181244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1882181244',id=38,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a83142058e2e4110b66f3067a0c0c1c7',ramdisk_id='',reservation_id='r-ie56go0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-503809711',owner_user_name='tempest-VolumesActionsTest-503809711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:56:30Z,user_data=None,user_id='682f4421b0de47a8a106621ff6c9ce9d',uuid=bb4793ee-3d31-41fe-9e1b-3d8442caf23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Converting VIF {"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG os_vif [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb08ad3a-8a67-51f2-85cc-0b7e5cd5d9a8', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap784cf525-e4, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap784cf525-e4, col_values=(('qos', UUID('eff6f85e-5831-456d-8b13-053c86bcb09b')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap784cf525-e4, col_values=(('external_ids', {'iface-id': '784cf525-e4a3-4ae2-9d34-4ea26539bffb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:6e:7c', 'vm-uuid': 'bb4793ee-3d31-41fe-9e1b-3d8442caf23a'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:32 user nova-compute[75354]: INFO os_vif [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4')
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] No VIF found with MAC fa:16:3e:b0:6e:7c, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updated VIF entry in instance network info cache for port 784cf525-e4a3-4ae2-9d34-4ea26539bffb. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updating instance_info_cache with network_info: [{"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0f8381da-48e8-4deb-8fde-d25b31ed90d5 req-813abcdc-a832-432d-afcd-e99a615a184d service nova] Releasing lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:56:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-92b5bd2e-e1a7-4867-9f5d-86b0ce0d3892 req-9e9f4069-5dea-410b-933c-0bc9ab3b7a51 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92b5bd2e-e1a7-4867-9f5d-86b0ce0d3892 req-9e9f4069-5dea-410b-933c-0bc9ab3b7a51 service nova] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92b5bd2e-e1a7-4867-9f5d-86b0ce0d3892 req-9e9f4069-5dea-410b-933c-0bc9ab3b7a51 service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-92b5bd2e-e1a7-4867-9f5d-86b0ce0d3892 req-9e9f4069-5dea-410b-933c-0bc9ab3b7a51 service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-92b5bd2e-e1a7-4867-9f5d-86b0ce0d3892 req-9e9f4069-5dea-410b-933c-0bc9ab3b7a51 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] No waiting events found dispatching network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:56:33 user nova-compute[75354]: WARNING nova.compute.manager [req-92b5bd2e-e1a7-4867-9f5d-86b0ce0d3892 req-9e9f4069-5dea-410b-933c-0bc9ab3b7a51 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received unexpected event network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb for instance with vm_state building and task_state spawning.
Nov 14 06:56:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:56:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Instance spawned successfully.
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:56:35 user nova-compute[75354]: INFO nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:56:35 user nova-compute[75354]: INFO nova.compute.manager [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Took 6.22 seconds to build instance.
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-6c6c78f5-11a7-4191-9897-aa56a3422469 req-88740725-4ad5-4d04-8ec7-235acb9166d5 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6c6c78f5-11a7-4191-9897-aa56a3422469 req-88740725-4ad5-4d04-8ec7-235acb9166d5 service nova] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6c6c78f5-11a7-4191-9897-aa56a3422469 req-88740725-4ad5-4d04-8ec7-235acb9166d5 service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6c6c78f5-11a7-4191-9897-aa56a3422469 req-88740725-4ad5-4d04-8ec7-235acb9166d5 service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-6c6c78f5-11a7-4191-9897-aa56a3422469 req-88740725-4ad5-4d04-8ec7-235acb9166d5 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] No waiting events found dispatching network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:56:35 user nova-compute[75354]: WARNING nova.compute.manager [req-6c6c78f5-11a7-4191-9897-aa56a3422469 req-88740725-4ad5-4d04-8ec7-235acb9166d5 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received unexpected event network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb for instance with vm_state active and task_state None.
Nov 14 06:56:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-621c451b-252c-454c-b915-0f5a21f271c6 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.324s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid bb4793ee-3d31-41fe-9e1b-3d8442caf23a {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:56:50 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:56:51 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:56:51 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.31545639038086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance bb4793ee-3d31-41fe-9e1b-3d8442caf23a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:56:51 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:56:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:56:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:56:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:56:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:54 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:56:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:56:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:56:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:56:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-changed-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:56:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Refreshing instance network info cache due to event network-changed-96080eb7-9544-4613-8ed6-e11adc9562a9. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:56:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] Acquiring lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:56:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] Acquired lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:56:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Refreshing network info cache for port 96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:57:00 user nova-compute[75354]: DEBUG nova.network.neutron [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updated VIF entry in instance network info cache for port 96080eb7-9544-4613-8ed6-e11adc9562a9. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:57:00 user nova-compute[75354]: DEBUG nova.network.neutron [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [{"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:57:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e301baf1-6f32-4c5a-9bc9-3f887e7d1b9c req-6b9f77de-5cbb-4e80-a838-deb9ece41add service nova] Releasing lock "refresh_cache-54f48ba8-3407-4cb9-8e6a-29c481f42a62" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG nova.objects.instance [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:01 user nova-compute[75354]: INFO nova.compute.manager [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Attaching volume c9d9e878-6482-4b77-8f82-9825b0f0d210 to /dev/vdb
Nov 14 06:57:01 user nova-compute[75354]: DEBUG os_brick.utils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[019e6f69-7fbf-41e8-84c5-55ca89bac5a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68d390-bb3b-4559-9976-f567f0ff61b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd822b-23b9-4b5d-995f-0936fe45e181]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b7668e-6735-4281-8e8d-b4f9dd0072c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 06:57:01 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 06:57:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3bbbd-d41f-420a-82b9-ae5a6477b7ca]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG os_brick.utils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:57:01 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating existing volume attachment record: d4972d20-b83d-464c-8642-af813536a500 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 06:57:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZuEtdhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:57:05 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:57:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:57:05 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:57:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:57:05 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 06:57:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9290b8-1bec-4cfe-98ba-18b53f523658]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 06:57:05 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c780ca5a-7a06-4792-8eb5-ed30f51e1d99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210] added
Nov 14 06:57:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56be5a-bc4c-4e70-93d2-311075658007]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd7ad33-0f89-4343-a72f-d33f4f30877b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZuEtdhH {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZuEtdhH" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[49213da6-4fd5-48ae-9b86-dab5e26d336a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZuEtdhH'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53509df8-6fbb-467c-9dde-26d9103a3c9d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f784f-1966-41b4-9069-96303e7fd6eb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 06:57:06 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 06:57:06 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:57:06 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 06:57:06 user nova-compute[75354]: 
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83babe5b-35f5-4790-9c47-cdc7e0155724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260]
Nov 14 06:57:06 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260] successful.
Nov 14 06:57:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3fcd7e-8d90-4d1c-90e7-04b3224be1d5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5c9f5-e9a5-47c3-aefa-8c48fa07925a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 (non-flash)
Nov 14 06:57:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 (non-flash)
Nov 14 06:57:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d32159-2f6e-4d6a-9590-3fd20b01b441]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 06:57:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZuEtdhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26166643836656234', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166643836656234', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 06:57:07 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:57:07 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:57:07 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:57:07 user nova-compute[75354]:   <serial>c9d9e878-6482-4b77-8f82-9825b0f0d210</serial>
Nov 14 06:57:07 user nova-compute[75354]: </disk>
Nov 14 06:57:07 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:62:bb:52, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:57:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-469ec978-b870-46ed-8c56-b16908514df6 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.101s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:08 user nova-compute[75354]: INFO nova.compute.manager [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Detaching volume c9d9e878-6482-4b77-8f82-9825b0f0d210
Nov 14 06:57:08 user nova-compute[75354]: INFO nova.virt.block_device [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Attempting to driver detach volume c9d9e878-6482-4b77-8f82-9825b0f0d210 from mountpoint /dev/vdb
Nov 14 06:57:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Attempting to detach device vdb from instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 06:57:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:57:08 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:57:08 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:57:08 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:57:08 user nova-compute[75354]:   <serial>c9d9e878-6482-4b77-8f82-9825b0f0d210</serial>
Nov 14 06:57:08 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:57:08 user nova-compute[75354]: </disk>
Nov 14 06:57:08 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:57:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully detached device vdb from instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 from the persistent domain config.
Nov 14 06:57:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 06:57:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 06:57:08 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 06:57:08 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 06:57:08 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 06:57:08 user nova-compute[75354]:   <serial>c9d9e878-6482-4b77-8f82-9825b0f0d210</serial>
Nov 14 06:57:08 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 06:57:08 user nova-compute[75354]: </disk>
Nov 14 06:57:08 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 06:57:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 06:57:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 is timed out.
Nov 14 06:57:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully detached device vdb from instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 from the live domain config.
Nov 14 06:57:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZuEtdhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 06:57:29 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a5a95-bf24-4856-850a-eb526783452e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 06:57:29 user nova-compute[75354]: No targets found.
Nov 14 06:57:29 user nova-compute[75354]: iSNS:
Nov 14 06:57:29 user nova-compute[75354]: No targets found.
Nov 14 06:57:29 user nova-compute[75354]: STATIC:
Nov 14 06:57:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210
Nov 14 06:57:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 06:57:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 06:57:29 user nova-compute[75354]: FIRMWARE:
Nov 14 06:57:29 user nova-compute[75354]: No targets found.
Nov 14 06:57:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 06:57:29 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 06:57:29 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[683ef3c7-b97c-4a77-af9f-1218ad12ed7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c58db4a-afb0-412c-99bd-e85e4617e28d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 (non-flash)
Nov 14 06:57:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 (non-flash)
Nov 14 06:57:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80987cfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b001d57-1c5f-4fe9-9f3a-8a39577edfcd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e997f406-f288-467a-9d41-828b165af57e]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a5812-7947-4f50-a740-c7fb288293a7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75473b3c-0dfc-452f-b661-92ce80b53293]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[11215daa-6c9f-4645-ba89-163f0fff6112]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcc650-b1ec-4ae8-8223-33b48a61a8df]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260]
Nov 14 06:57:29 user nova-compute[75354]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210, portal: 172.16.0.220,3260] successful.
Nov 14 06:57:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d9e878-6482-4b77-8f82-9825b0f0d210 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e174c48-a368-425c-94e3-b237cc477413]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== disconnect_volume: return (337ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:29 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:57:29 user nova-compute[75354]: INFO nova.compute.claims [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Claim successful on node user
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:57:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.policy [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28e683728363464390df26c284fad546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5933e720dc9e4cbcb4328fb33a4909c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:57:30 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Creating image(s)
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "/opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "/opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "/opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1d090a60-7154-451f-b8da-1cf15ca58a01 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk 1073741824" returned: 0 in 0.071s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:30 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Successfully created port: e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Cannot resize image /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Ensure instance console log exists: /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Successfully updated port: e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquired lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-changed-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Refreshing instance network info cache due to event network-changed-e026065e-14fb-46c9-8770-e2f397d682bc. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] Acquiring lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.neutron [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Updating instance_info_cache with network_info: [{"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Releasing lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Instance network_info: |[{"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] Acquired lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.neutron [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Refreshing network info cache for port e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Start _get_guest_xml network_info=[{"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:57:31 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:57:31 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897553137',display_name='tempest-VolumesActionsTest-instance-897553137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897553137',id=39,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5933e720dc9e4cbcb4328fb33a4909c1',ramdisk_id='',reservation_id='r-oslyvum3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1765535248',owner_user_name='tempest-VolumesActionsTest-1765535248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:57:30Z,user_data=None,user_id='28e683728363464390df26c284fad546',uuid=a84e74f6-fc26-4fe2-9690-f839925ae3f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converting VIF {"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lazy-loading 'pci_devices' on Instance uuid a84e74f6-fc26-4fe2-9690-f839925ae3f1 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:57:31 user nova-compute[75354]:   <uuid>a84e74f6-fc26-4fe2-9690-f839925ae3f1</uuid>
Nov 14 06:57:31 user nova-compute[75354]:   <name>instance-00000027</name>
Nov 14 06:57:31 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:57:31 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:57:31 user nova-compute[75354]:   <metadata>
Nov 14 06:57:31 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:57:31 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:57:31 user nova-compute[75354]:       <nova:name>tempest-VolumesActionsTest-instance-897553137</nova:name>
Nov 14 06:57:31 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:57:31</nova:creationTime>
Nov 14 06:57:31 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:57:31 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:57:31 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:57:31 user nova-compute[75354]:       <nova:owner>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:user uuid="28e683728363464390df26c284fad546">tempest-VolumesActionsTest-1765535248-project-member</nova:user>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:project uuid="5933e720dc9e4cbcb4328fb33a4909c1">tempest-VolumesActionsTest-1765535248</nova:project>
Nov 14 06:57:31 user nova-compute[75354]:       </nova:owner>
Nov 14 06:57:31 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:57:31 user nova-compute[75354]:       <nova:ports>
Nov 14 06:57:31 user nova-compute[75354]:         <nova:port uuid="e026065e-14fb-46c9-8770-e2f397d682bc">
Nov 14 06:57:31 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 06:57:31 user nova-compute[75354]:         </nova:port>
Nov 14 06:57:31 user nova-compute[75354]:       </nova:ports>
Nov 14 06:57:31 user nova-compute[75354]:     </nova:instance>
Nov 14 06:57:31 user nova-compute[75354]:   </metadata>
Nov 14 06:57:31 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:57:31 user nova-compute[75354]:     <system>
Nov 14 06:57:31 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:57:31 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:57:31 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:57:31 user nova-compute[75354]:       <entry name="serial">a84e74f6-fc26-4fe2-9690-f839925ae3f1</entry>
Nov 14 06:57:31 user nova-compute[75354]:       <entry name="uuid">a84e74f6-fc26-4fe2-9690-f839925ae3f1</entry>
Nov 14 06:57:31 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:57:31 user nova-compute[75354]:     </system>
Nov 14 06:57:31 user nova-compute[75354]:   </sysinfo>
Nov 14 06:57:31 user nova-compute[75354]:   <os>
Nov 14 06:57:31 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:57:31 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:57:31 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:57:31 user nova-compute[75354]:   </os>
Nov 14 06:57:31 user nova-compute[75354]:   <features>
Nov 14 06:57:31 user nova-compute[75354]:     <acpi/>
Nov 14 06:57:31 user nova-compute[75354]:     <apic/>
Nov 14 06:57:31 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:57:31 user nova-compute[75354]:   </features>
Nov 14 06:57:31 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:57:31 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:57:31 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:57:31 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:57:31 user nova-compute[75354]:   </clock>
Nov 14 06:57:31 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:57:31 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:57:31 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:57:31 user nova-compute[75354]:   </cpu>
Nov 14 06:57:31 user nova-compute[75354]:   <devices>
Nov 14 06:57:31 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:57:31 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:57:31 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk"/>
Nov 14 06:57:31 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:57:31 user nova-compute[75354]:     </disk>
Nov 14 06:57:31 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:57:31 user nova-compute[75354]:       <mac address="fa:16:3e:e0:a3:96"/>
Nov 14 06:57:31 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:57:31 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:57:31 user nova-compute[75354]:       <target dev="tape026065e-14"/>
Nov 14 06:57:31 user nova-compute[75354]:     </interface>
Nov 14 06:57:31 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:57:31 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/console.log" append="off"/>
Nov 14 06:57:31 user nova-compute[75354]:     </serial>
Nov 14 06:57:31 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:57:31 user nova-compute[75354]:     <video>
Nov 14 06:57:31 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:57:31 user nova-compute[75354]:     </video>
Nov 14 06:57:31 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:57:31 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:57:31 user nova-compute[75354]:     </rng>
Nov 14 06:57:31 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:57:31 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:57:31 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:57:31 user nova-compute[75354]:     </memballoon>
Nov 14 06:57:31 user nova-compute[75354]:   </devices>
Nov 14 06:57:31 user nova-compute[75354]: </domain>
Nov 14 06:57:31 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897553137',display_name='tempest-VolumesActionsTest-instance-897553137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897553137',id=39,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5933e720dc9e4cbcb4328fb33a4909c1',ramdisk_id='',reservation_id='r-oslyvum3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1765535248',owner_user_name='tempest-VolumesActionsTest-1765535248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:57:30Z,user_data=None,user_id='28e683728363464390df26c284fad546',uuid=a84e74f6-fc26-4fe2-9690-f839925ae3f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converting VIF {"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG os_vif [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80915e8f-fd73-5254-bc11-d68718583aa9', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape026065e-14, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape026065e-14, col_values=(('qos', UUID('7c2637dd-69c4-478d-9791-75ea5b88695c')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape026065e-14, col_values=(('external_ids', {'iface-id': 'e026065e-14fb-46c9-8770-e2f397d682bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a3:96', 'vm-uuid': 'a84e74f6-fc26-4fe2-9690-f839925ae3f1'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:31 user nova-compute[75354]: INFO os_vif [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14')
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:57:31 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] No VIF found with MAC fa:16:3e:e0:a3:96, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:57:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Updated VIF entry in instance network info cache for port e026065e-14fb-46c9-8770-e2f397d682bc. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:57:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Updating instance_info_cache with network_info: [{"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:57:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c3191040-abd4-44ff-8d81-4650214bd267 req-f7dc83a6-3543-440c-b866-7c367d57d9b1 service nova] Releasing lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-dc55bcfb-3621-4b33-827c-209a783a9679 req-925a84e7-29ec-43ea-8191-a70c23fac553 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dc55bcfb-3621-4b33-827c-209a783a9679 req-925a84e7-29ec-43ea-8191-a70c23fac553 service nova] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dc55bcfb-3621-4b33-827c-209a783a9679 req-925a84e7-29ec-43ea-8191-a70c23fac553 service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-dc55bcfb-3621-4b33-827c-209a783a9679 req-925a84e7-29ec-43ea-8191-a70c23fac553 service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-dc55bcfb-3621-4b33-827c-209a783a9679 req-925a84e7-29ec-43ea-8191-a70c23fac553 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] No waiting events found dispatching network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:57:33 user nova-compute[75354]: WARNING nova.compute.manager [req-dc55bcfb-3621-4b33-827c-209a783a9679 req-925a84e7-29ec-43ea-8191-a70c23fac553 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received unexpected event network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc for instance with vm_state building and task_state spawning.
Nov 14 06:57:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:57:35 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Instance spawned successfully.
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:57:35 user nova-compute[75354]: INFO nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:57:35 user nova-compute[75354]: INFO nova.compute.manager [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Took 5.61 seconds to build instance.
Nov 14 06:57:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a2c98829-445d-43a3-898b-c9f823dc7c4f tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.706s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-efeace2a-3e92-4ccb-b268-28f7c4e9d5d9 req-a4c46fd0-f1b5-4a31-9a15-28961ddb8bae service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efeace2a-3e92-4ccb-b268-28f7c4e9d5d9 req-a4c46fd0-f1b5-4a31-9a15-28961ddb8bae service nova] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efeace2a-3e92-4ccb-b268-28f7c4e9d5d9 req-a4c46fd0-f1b5-4a31-9a15-28961ddb8bae service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-efeace2a-3e92-4ccb-b268-28f7c4e9d5d9 req-a4c46fd0-f1b5-4a31-9a15-28961ddb8bae service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-efeace2a-3e92-4ccb-b268-28f7c4e9d5d9 req-a4c46fd0-f1b5-4a31-9a15-28961ddb8bae service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] No waiting events found dispatching network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:57:35 user nova-compute[75354]: WARNING nova.compute.manager [req-efeace2a-3e92-4ccb-b268-28f7c4e9d5d9 req-a4c46fd0-f1b5-4a31-9a15-28961ddb8bae service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received unexpected event network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc for instance with vm_state active and task_state None.
Nov 14 06:57:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:57:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:57:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.283580780029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance bb4793ee-3d31-41fe-9e1b-3d8442caf23a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a84e74f6-fc26-4fe2-9690-f839925ae3f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:57:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:53 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:57:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:59 user nova-compute[75354]: INFO nova.compute.manager [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Terminating instance
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-e58ce5bf-5ead-4171-af02-41a63a66b664 req-c327513b-a140-442a-b7c2-3ea843d2c34c service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-unplugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e58ce5bf-5ead-4171-af02-41a63a66b664 req-c327513b-a140-442a-b7c2-3ea843d2c34c service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e58ce5bf-5ead-4171-af02-41a63a66b664 req-c327513b-a140-442a-b7c2-3ea843d2c34c service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e58ce5bf-5ead-4171-af02-41a63a66b664 req-c327513b-a140-442a-b7c2-3ea843d2c34c service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-e58ce5bf-5ead-4171-af02-41a63a66b664 req-c327513b-a140-442a-b7c2-3ea843d2c34c service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-unplugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-e58ce5bf-5ead-4171-af02-41a63a66b664 req-c327513b-a140-442a-b7c2-3ea843d2c34c service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-unplugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Instance destroyed successfully.
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.objects.instance [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'resources' on Instance uuid 54f48ba8-3407-4cb9-8e6a-29c481f42a62 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-249862347',display_name='tempest-AttachVolumeNegativeTest-server-249862347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-249862347',id=37,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr8BS6qEC/mR2aNUfrz3PuYyuhyuGBdarPcePGaRLed2wLUlDL/M72NoN+cwUAo+w2GzNYR6MTBic1edlFwKGDcDfcj7ysGeYDuTA22EbcB1I7zuD/zRZvQmkan5vJ8Cg==',key_name='tempest-keypair-958532620',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:55:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-ux5g9l37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=54f48ba8-3407-4cb9-8e6a-29c481f42a62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "96080eb7-9544-4613-8ed6-e11adc9562a9", "address": "fa:16:3e:62:bb:52", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96080eb7-95", "ovs_interfaceid": "96080eb7-9544-4613-8ed6-e11adc9562a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG os_vif [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96080eb7-95, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a19b6f8-8edc-46cc-8f13-4c3a7f2333ee) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:57:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:57:59 user nova-compute[75354]: INFO os_vif [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:bb:52,bridge_name='br-int',has_traffic_filtering=True,id=96080eb7-9544-4613-8ed6-e11adc9562a9,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96080eb7-95')
Nov 14 06:57:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Deleting instance files /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62_del
Nov 14 06:57:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Deletion of /opt/stack/data/nova/instances/54f48ba8-3407-4cb9-8e6a-29c481f42a62_del complete
Nov 14 06:58:00 user nova-compute[75354]: INFO nova.compute.manager [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:00 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Took 0.73 seconds to deallocate network for instance.
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-b6944058-2098-4b1f-8d4c-603caf75f10a req-87893fe3-719c-4b00-aea6-4cf851312ddf service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-deleted-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:00 user nova-compute[75354]: INFO nova.compute.manager [req-b6944058-2098-4b1f-8d4c-603caf75f10a req-87893fe3-719c-4b00-aea6-4cf851312ddf service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Neutron deleted interface 96080eb7-9544-4613-8ed6-e11adc9562a9; detaching it from the instance and deleting it from the info cache
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.network.neutron [req-b6944058-2098-4b1f-8d4c-603caf75f10a req-87893fe3-719c-4b00-aea6-4cf851312ddf service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-b6944058-2098-4b1f-8d4c-603caf75f10a req-87893fe3-719c-4b00-aea6-4cf851312ddf service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Detach interface failed, port_id=96080eb7-9544-4613-8ed6-e11adc9562a9, reason: Instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updating instance_info_cache with network_info: [{"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-bb4793ee-3d31-41fe-9e1b-3d8442caf23a" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:58:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Deleted allocations for instance 54f48ba8-3407-4cb9-8e6a-29c481f42a62
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-d36232d9-f755-4a9f-8392-9e12c48a3833 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:01 user nova-compute[75354]: WARNING nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state deleted and task_state None.
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:01 user nova-compute[75354]: WARNING nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state deleted and task_state None.
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:01 user nova-compute[75354]: WARNING nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state deleted and task_state None.
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-unplugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-unplugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:01 user nova-compute[75354]: WARNING nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-unplugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state deleted and task_state None.
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Acquiring lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] Lock "54f48ba8-3407-4cb9-8e6a-29c481f42a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] No waiting events found dispatching network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:01 user nova-compute[75354]: WARNING nova.compute.manager [req-2d80831b-fb17-4e04-8347-65d4f26a4519 req-caf87735-12e8-4fa7-86df-6752a5a1d09a service nova] [instance: 54f48ba8-3407-4cb9-8e6a-29c481f42a62] Received unexpected event network-vif-plugged-96080eb7-9544-4613-8ed6-e11adc9562a9 for instance with vm_state deleted and task_state None.
Nov 14 06:58:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:04 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:24 user nova-compute[75354]: INFO nova.compute.manager [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Terminating instance
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-17eb52a2-b877-46bd-9b1b-4ec1186ad703 req-86589378-cc63-4f0d-81e5-43ff563f76da service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-vif-unplugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17eb52a2-b877-46bd-9b1b-4ec1186ad703 req-86589378-cc63-4f0d-81e5-43ff563f76da service nova] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17eb52a2-b877-46bd-9b1b-4ec1186ad703 req-86589378-cc63-4f0d-81e5-43ff563f76da service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-17eb52a2-b877-46bd-9b1b-4ec1186ad703 req-86589378-cc63-4f0d-81e5-43ff563f76da service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-17eb52a2-b877-46bd-9b1b-4ec1186ad703 req-86589378-cc63-4f0d-81e5-43ff563f76da service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] No waiting events found dispatching network-vif-unplugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-17eb52a2-b877-46bd-9b1b-4ec1186ad703 req-86589378-cc63-4f0d-81e5-43ff563f76da service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-vif-unplugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Instance destroyed successfully.
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lazy-loading 'resources' on Instance uuid bb4793ee-3d31-41fe-9e1b-3d8442caf23a {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1882181244',display_name='tempest-VolumesActionsTest-instance-1882181244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1882181244',id=38,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a83142058e2e4110b66f3067a0c0c1c7',ramdisk_id='',reservation_id='r-ie56go0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-503809711',owner_user_name='tempest-VolumesActionsTest-503809711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:56:36Z,user_data=None,user_id='682f4421b0de47a8a106621ff6c9ce9d',uuid=bb4793ee-3d31-41fe-9e1b-3d8442caf23a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Converting VIF {"id": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "address": "fa:16:3e:b0:6e:7c", "network": {"id": "f9959034-d1b4-4ba2-8c4b-94ee866c2d8b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2087708674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a83142058e2e4110b66f3067a0c0c1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784cf525-e4", "ovs_interfaceid": "784cf525-e4a3-4ae2-9d34-4ea26539bffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG os_vif [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap784cf525-e4, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eff6f85e-5831-456d-8b13-053c86bcb09b) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:24 user nova-compute[75354]: INFO os_vif [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6e:7c,bridge_name='br-int',has_traffic_filtering=True,id=784cf525-e4a3-4ae2-9d34-4ea26539bffb,network=Network(f9959034-d1b4-4ba2-8c4b-94ee866c2d8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784cf525-e4')
Nov 14 06:58:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Deleting instance files /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a_del
Nov 14 06:58:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Deletion of /opt/stack/data/nova/instances/bb4793ee-3d31-41fe-9e1b-3d8442caf23a_del complete
Nov 14 06:58:25 user nova-compute[75354]: INFO nova.compute.manager [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 06:58:25 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:25 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Took 0.46 seconds to deallocate network for instance.
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-8f8b65bb-20bc-4d69-9908-3f1dac8a345e req-e478a284-9a5b-49ed-934a-2cf05cf307f0 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-vif-deleted-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:25 user nova-compute[75354]: INFO nova.compute.manager [req-8f8b65bb-20bc-4d69-9908-3f1dac8a345e req-e478a284-9a5b-49ed-934a-2cf05cf307f0 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Neutron deleted interface 784cf525-e4a3-4ae2-9d34-4ea26539bffb; detaching it from the instance and deleting it from the info cache
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.network.neutron [req-8f8b65bb-20bc-4d69-9908-3f1dac8a345e req-e478a284-9a5b-49ed-934a-2cf05cf307f0 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-8f8b65bb-20bc-4d69-9908-3f1dac8a345e req-e478a284-9a5b-49ed-934a-2cf05cf307f0 service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Detach interface failed, port_id=784cf525-e4a3-4ae2-9d34-4ea26539bffb, reason: Instance bb4793ee-3d31-41fe-9e1b-3d8442caf23a could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:58:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:25 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Deleted allocations for instance bb4793ee-3d31-41fe-9e1b-3d8442caf23a
Nov 14 06:58:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9a9726c9-12c0-4ad9-8507-304cb905ec72 tempest-VolumesActionsTest-503809711 tempest-VolumesActionsTest-503809711-project-member] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.446s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-e8506d6e-c264-40cd-9406-0e714b1856af req-692d905b-4d24-4ed9-ad65-c4980522b71d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received event network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e8506d6e-c264-40cd-9406-0e714b1856af req-692d905b-4d24-4ed9-ad65-c4980522b71d service nova] Acquiring lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e8506d6e-c264-40cd-9406-0e714b1856af req-692d905b-4d24-4ed9-ad65-c4980522b71d service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e8506d6e-c264-40cd-9406-0e714b1856af req-692d905b-4d24-4ed9-ad65-c4980522b71d service nova] Lock "bb4793ee-3d31-41fe-9e1b-3d8442caf23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-e8506d6e-c264-40cd-9406-0e714b1856af req-692d905b-4d24-4ed9-ad65-c4980522b71d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] No waiting events found dispatching network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:26 user nova-compute[75354]: WARNING nova.compute.manager [req-e8506d6e-c264-40cd-9406-0e714b1856af req-692d905b-4d24-4ed9-ad65-c4980522b71d service nova] [instance: bb4793ee-3d31-41fe-9e1b-3d8442caf23a] Received unexpected event network-vif-plugged-784cf525-e4a3-4ae2-9d34-4ea26539bffb for instance with vm_state deleted and task_state None.
Nov 14 06:58:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:58:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:58:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:58:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:58:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:58:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:58:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:51 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:58:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:58:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.336368560791016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a84e74f6-fc26-4fe2-9690-f839925ae3f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:58:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 06:58:53 user nova-compute[75354]: INFO nova.compute.claims [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Claim successful on node user
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 06:58:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.policy [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a633fa123bb74524b360106dc68456b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930e51c7a6574779985bacd62c89cdf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 06:58:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Creating image(s)
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "/opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "/opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk 1073741824" returned: 0 in 0.053s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Successfully created port: b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Cannot resize image /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Ensure instance console log exists: /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Successfully updated port: b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquired lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-changed-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.compute.manager [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Refreshing instance network info cache due to event network-changed-b6e1dcde-d382-483a-9ab6-74f443246e78. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] Acquiring lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating instance_info_cache with network_info: [{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Releasing lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Instance network_info: |[{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] Acquired lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Refreshing network info cache for port b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Start _get_guest_xml network_info=[{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 06:58:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:58:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-300686613',display_name='tempest-AttachVolumeNegativeTest-server-300686613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-300686613',id=40,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBImlT3uUj09lY5dL1MfnZwThBe7fEw0+z4qLLMGJeK6Cupx6bHRuInghcdnfxYK8psfCWMKyDdNQzwtunIbeQrHATtfdTirIyWNE64rMNNcWJMZZt4DXi/Uaghy0snBPQ==',key_name='tempest-keypair-804225848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-7oc4azx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=7430b806-60c9-441c-95cc-3e95c63575be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.objects.instance [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'pci_devices' on Instance uuid 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] End _get_guest_xml xml=<domain type="kvm">
Nov 14 06:58:55 user nova-compute[75354]:   <uuid>7430b806-60c9-441c-95cc-3e95c63575be</uuid>
Nov 14 06:58:55 user nova-compute[75354]:   <name>instance-00000028</name>
Nov 14 06:58:55 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 06:58:55 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 06:58:55 user nova-compute[75354]:   <metadata>
Nov 14 06:58:55 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 06:58:55 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 06:58:55 user nova-compute[75354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-300686613</nova:name>
Nov 14 06:58:55 user nova-compute[75354]:       <nova:creationTime>2023-11-14 06:58:55</nova:creationTime>
Nov 14 06:58:55 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 06:58:55 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 06:58:55 user nova-compute[75354]:       </nova:flavor>
Nov 14 06:58:55 user nova-compute[75354]:       <nova:owner>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:user uuid="a633fa123bb74524b360106dc68456b5">tempest-AttachVolumeNegativeTest-365177810-project-member</nova:user>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:project uuid="930e51c7a6574779985bacd62c89cdf6">tempest-AttachVolumeNegativeTest-365177810</nova:project>
Nov 14 06:58:55 user nova-compute[75354]:       </nova:owner>
Nov 14 06:58:55 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 06:58:55 user nova-compute[75354]:       <nova:ports>
Nov 14 06:58:55 user nova-compute[75354]:         <nova:port uuid="b6e1dcde-d382-483a-9ab6-74f443246e78">
Nov 14 06:58:55 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 06:58:55 user nova-compute[75354]:         </nova:port>
Nov 14 06:58:55 user nova-compute[75354]:       </nova:ports>
Nov 14 06:58:55 user nova-compute[75354]:     </nova:instance>
Nov 14 06:58:55 user nova-compute[75354]:   </metadata>
Nov 14 06:58:55 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 06:58:55 user nova-compute[75354]:     <system>
Nov 14 06:58:55 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 06:58:55 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 06:58:55 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 06:58:55 user nova-compute[75354]:       <entry name="serial">7430b806-60c9-441c-95cc-3e95c63575be</entry>
Nov 14 06:58:55 user nova-compute[75354]:       <entry name="uuid">7430b806-60c9-441c-95cc-3e95c63575be</entry>
Nov 14 06:58:55 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 06:58:55 user nova-compute[75354]:     </system>
Nov 14 06:58:55 user nova-compute[75354]:   </sysinfo>
Nov 14 06:58:55 user nova-compute[75354]:   <os>
Nov 14 06:58:55 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 06:58:55 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 06:58:55 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 06:58:55 user nova-compute[75354]:   </os>
Nov 14 06:58:55 user nova-compute[75354]:   <features>
Nov 14 06:58:55 user nova-compute[75354]:     <acpi/>
Nov 14 06:58:55 user nova-compute[75354]:     <apic/>
Nov 14 06:58:55 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 06:58:55 user nova-compute[75354]:   </features>
Nov 14 06:58:55 user nova-compute[75354]:   <clock offset="utc">
Nov 14 06:58:55 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 06:58:55 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 06:58:55 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 06:58:55 user nova-compute[75354]:   </clock>
Nov 14 06:58:55 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 06:58:55 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 06:58:55 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 06:58:55 user nova-compute[75354]:   </cpu>
Nov 14 06:58:55 user nova-compute[75354]:   <devices>
Nov 14 06:58:55 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 06:58:55 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 06:58:55 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk"/>
Nov 14 06:58:55 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 06:58:55 user nova-compute[75354]:     </disk>
Nov 14 06:58:55 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 06:58:55 user nova-compute[75354]:       <mac address="fa:16:3e:5e:ab:f0"/>
Nov 14 06:58:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:58:55 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 06:58:55 user nova-compute[75354]:       <target dev="tapb6e1dcde-d3"/>
Nov 14 06:58:55 user nova-compute[75354]:     </interface>
Nov 14 06:58:55 user nova-compute[75354]:     <serial type="pty">
Nov 14 06:58:55 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/console.log" append="off"/>
Nov 14 06:58:55 user nova-compute[75354]:     </serial>
Nov 14 06:58:55 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 06:58:55 user nova-compute[75354]:     <video>
Nov 14 06:58:55 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 06:58:55 user nova-compute[75354]:     </video>
Nov 14 06:58:55 user nova-compute[75354]:     <rng model="virtio">
Nov 14 06:58:55 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 06:58:55 user nova-compute[75354]:     </rng>
Nov 14 06:58:55 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 06:58:55 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 06:58:55 user nova-compute[75354]:       <stats period="10"/>
Nov 14 06:58:55 user nova-compute[75354]:     </memballoon>
Nov 14 06:58:55 user nova-compute[75354]:   </devices>
Nov 14 06:58:55 user nova-compute[75354]: </domain>
Nov 14 06:58:55 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-300686613',display_name='tempest-AttachVolumeNegativeTest-server-300686613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-300686613',id=40,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBImlT3uUj09lY5dL1MfnZwThBe7fEw0+z4qLLMGJeK6Cupx6bHRuInghcdnfxYK8psfCWMKyDdNQzwtunIbeQrHATtfdTirIyWNE64rMNNcWJMZZt4DXi/Uaghy0snBPQ==',key_name='tempest-keypair-804225848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-7oc4azx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T06:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=7430b806-60c9-441c-95cc-3e95c63575be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG os_vif [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50305f8a-9ec0-5376-9e43-c3840e4f3c1a', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6e1dcde-d3, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6e1dcde-d3, col_values=(('qos', UUID('613406be-4c20-4258-9202-dd0281b61889')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6e1dcde-d3, col_values=(('external_ids', {'iface-id': 'b6e1dcde-d382-483a-9ab6-74f443246e78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:ab:f0', 'vm-uuid': '7430b806-60c9-441c-95cc-3e95c63575be'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:55 user nova-compute[75354]: INFO os_vif [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3')
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:5e:ab:f0, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updated VIF entry in instance network info cache for port b6e1dcde-d382-483a-9ab6-74f443246e78. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG nova.network.neutron [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating instance_info_cache with network_info: [{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:58:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af4f8325-d79e-473c-8391-f0f5a1db2cb0 req-41bff72c-c9f4-4c15-bf1b-2fdc573b12c7 service nova] Releasing lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:58:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-5bc793db-2578-453a-9fbe-19aabe9fab68 req-63c1cf3b-58dc-4765-bf31-c473f83b5666 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5bc793db-2578-453a-9fbe-19aabe9fab68 req-63c1cf3b-58dc-4765-bf31-c473f83b5666 service nova] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5bc793db-2578-453a-9fbe-19aabe9fab68 req-63c1cf3b-58dc-4765-bf31-c473f83b5666 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-5bc793db-2578-453a-9fbe-19aabe9fab68 req-63c1cf3b-58dc-4765-bf31-c473f83b5666 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-5bc793db-2578-453a-9fbe-19aabe9fab68 req-63c1cf3b-58dc-4765-bf31-c473f83b5666 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] No waiting events found dispatching network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:57 user nova-compute[75354]: WARNING nova.compute.manager [req-5bc793db-2578-453a-9fbe-19aabe9fab68 req-63c1cf3b-58dc-4765-bf31-c473f83b5666 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received unexpected event network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 for instance with vm_state building and task_state spawning.
Nov 14 06:58:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 06:58:59 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Instance spawned successfully.
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:58:59 user nova-compute[75354]: INFO nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 06:58:59 user nova-compute[75354]: INFO nova.compute.manager [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Took 5.80 seconds to build instance.
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-584ad84d-c19c-4bc0-93a4-ecbce8099e38 req-4d9ce66f-eff7-4311-9b5c-134d285e0e45 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-584ad84d-c19c-4bc0-93a4-ecbce8099e38 req-4d9ce66f-eff7-4311-9b5c-134d285e0e45 service nova] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-584ad84d-c19c-4bc0-93a4-ecbce8099e38 req-4d9ce66f-eff7-4311-9b5c-134d285e0e45 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-584ad84d-c19c-4bc0-93a4-ecbce8099e38 req-4d9ce66f-eff7-4311-9b5c-134d285e0e45 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:58:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-584ad84d-c19c-4bc0-93a4-ecbce8099e38 req-4d9ce66f-eff7-4311-9b5c-134d285e0e45 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] No waiting events found dispatching network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:58:59 user nova-compute[75354]: WARNING nova.compute.manager [req-584ad84d-c19c-4bc0-93a4-ecbce8099e38 req-4d9ce66f-eff7-4311-9b5c-134d285e0e45 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received unexpected event network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 for instance with vm_state active and task_state None.
Nov 14 06:58:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-04e42271-ed74-4c92-806b-674532c1d057 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.894s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid a84e74f6-fc26-4fe2-9690-f839925ae3f1 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Updating instance_info_cache with network_info: [{"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-a84e74f6-fc26-4fe2-9690-f839925ae3f1" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 06:59:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 06:59:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:59:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:20 user nova-compute[75354]: INFO nova.compute.manager [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Terminating instance
Nov 14 06:59:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-8b4947ed-4627-4254-ad31-712c0ee5815f req-ab2f4959-92a6-4324-968b-237e14efb404 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-vif-unplugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8b4947ed-4627-4254-ad31-712c0ee5815f req-ab2f4959-92a6-4324-968b-237e14efb404 service nova] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8b4947ed-4627-4254-ad31-712c0ee5815f req-ab2f4959-92a6-4324-968b-237e14efb404 service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8b4947ed-4627-4254-ad31-712c0ee5815f req-ab2f4959-92a6-4324-968b-237e14efb404 service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-8b4947ed-4627-4254-ad31-712c0ee5815f req-ab2f4959-92a6-4324-968b-237e14efb404 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] No waiting events found dispatching network-vif-unplugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG nova.compute.manager [req-8b4947ed-4627-4254-ad31-712c0ee5815f req-ab2f4959-92a6-4324-968b-237e14efb404 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-vif-unplugged-e026065e-14fb-46c9-8770-e2f397d682bc for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 06:59:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Instance destroyed successfully.
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lazy-loading 'resources' on Instance uuid a84e74f6-fc26-4fe2-9690-f839925ae3f1 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897553137',display_name='tempest-VolumesActionsTest-instance-897553137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897553137',id=39,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5933e720dc9e4cbcb4328fb33a4909c1',ramdisk_id='',reservation_id='r-oslyvum3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1765535248',owner_user_name='tempest-VolumesActionsTest-1765535248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:57:35Z,user_data=None,user_id='28e683728363464390df26c284fad546',uuid=a84e74f6-fc26-4fe2-9690-f839925ae3f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converting VIF {"id": "e026065e-14fb-46c9-8770-e2f397d682bc", "address": "fa:16:3e:e0:a3:96", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026065e-14", "ovs_interfaceid": "e026065e-14fb-46c9-8770-e2f397d682bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG os_vif [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape026065e-14, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c2637dd-69c4-478d-9791-75ea5b88695c) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:59:21 user nova-compute[75354]: INFO os_vif [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a3:96,bridge_name='br-int',has_traffic_filtering=True,id=e026065e-14fb-46c9-8770-e2f397d682bc,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026065e-14')
Nov 14 06:59:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Deleting instance files /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1_del
Nov 14 06:59:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Deletion of /opt/stack/data/nova/instances/a84e74f6-fc26-4fe2-9690-f839925ae3f1_del complete
Nov 14 06:59:21 user nova-compute[75354]: INFO nova.compute.manager [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 06:59:21 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 06:59:21 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Took 0.40 seconds to deallocate network for instance.
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-a0ab08ca-2434-4737-b88f-9c2433a8f906 req-4fe4544f-faaa-483d-84cc-99f4767c9059 service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-vif-deleted-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:59:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:21 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Deleted allocations for instance a84e74f6-fc26-4fe2-9690-f839925ae3f1
Nov 14 06:59:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f7fd4825-0757-45df-8573-9053676f7b72 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.655s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-772727b8-bd1b-4d63-965b-3211082facd9 req-dd991259-6a73-49f7-9d12-7ffdbd1dd84f service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received event network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 06:59:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-772727b8-bd1b-4d63-965b-3211082facd9 req-dd991259-6a73-49f7-9d12-7ffdbd1dd84f service nova] Acquiring lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-772727b8-bd1b-4d63-965b-3211082facd9 req-dd991259-6a73-49f7-9d12-7ffdbd1dd84f service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-772727b8-bd1b-4d63-965b-3211082facd9 req-dd991259-6a73-49f7-9d12-7ffdbd1dd84f service nova] Lock "a84e74f6-fc26-4fe2-9690-f839925ae3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:22 user nova-compute[75354]: DEBUG nova.compute.manager [req-772727b8-bd1b-4d63-965b-3211082facd9 req-dd991259-6a73-49f7-9d12-7ffdbd1dd84f service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] No waiting events found dispatching network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 06:59:22 user nova-compute[75354]: WARNING nova.compute.manager [req-772727b8-bd1b-4d63-965b-3211082facd9 req-dd991259-6a73-49f7-9d12-7ffdbd1dd84f service nova] [instance: a84e74f6-fc26-4fe2-9690-f839925ae3f1] Received unexpected event network-vif-plugged-e026065e-14fb-46c9-8770-e2f397d682bc for instance with vm_state deleted and task_state None.
Nov 14 06:59:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:59:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:59:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 06:59:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:59:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 06:59:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 06:59:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:59:52 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 06:59:52 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.324962615966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 06:59:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 7430b806-60c9-441c-95cc-3e95c63575be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 06:59:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 06:59:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 06:59:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 06:59:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 06:59:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating instance_info_cache with network_info: [{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:00:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:00:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "80774ec6-35d5-4ea8-b232-90151e986b08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:00:11 user nova-compute[75354]: INFO nova.compute.claims [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Claim successful on node user
Nov 14 07:00:11 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:00:11 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:00:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.policy [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28e683728363464390df26c284fad546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5933e720dc9e4cbcb4328fb33a4909c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:00:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Creating image(s)
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "/opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "/opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "/opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:00:12 user nova-compute[75354]: INFO nova.compute.claims [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Claim successful on node user
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Successfully created port: 3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.543s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk 1073741824" returned: 0 in 0.060s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.615s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:00:13 user nova-compute[75354]: INFO nova.virt.block_device [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Booting with volume snapshot 7a879b0f-a747-4889-9ee4-6155ab78bcdf at /dev/vda
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.policy [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f9b73f37fb4801aa39ff23e1a095cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9131ea3f6241aead77fcf82f1e8000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Cannot resize image /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Ensure instance console log exists: /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Successfully updated port: 3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "refresh_cache-80774ec6-35d5-4ea8-b232-90151e986b08" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquired lock "refresh_cache-80774ec6-35d5-4ea8-b232-90151e986b08" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-changed-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Refreshing instance network info cache due to event network-changed-3e2abb56-c8fd-439c-8979-7f034c99ae53. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] Acquiring lock "refresh_cache-80774ec6-35d5-4ea8-b232-90151e986b08" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Updating instance_info_cache with network_info: [{"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Successfully created port: 55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Releasing lock "refresh_cache-80774ec6-35d5-4ea8-b232-90151e986b08" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Instance network_info: |[{"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] Acquired lock "refresh_cache-80774ec6-35d5-4ea8-b232-90151e986b08" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Refreshing network info cache for port 3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Start _get_guest_xml network_info=[{"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:00:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:00:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:00:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2114556554',display_name='tempest-VolumesActionsTest-instance-2114556554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2114556554',id=41,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5933e720dc9e4cbcb4328fb33a4909c1',ramdisk_id='',reservation_id='r-9wbenlgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1765535248',owner_user_name='tempest-VolumesActionsTest-1765535248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:00:12Z,user_data=None,user_id='28e683728363464390df26c284fad546',uuid=80774ec6-35d5-4ea8-b232-90151e986b08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converting VIF {"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lazy-loading 'pci_devices' on Instance uuid 80774ec6-35d5-4ea8-b232-90151e986b08 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:00:14 user nova-compute[75354]:   <uuid>80774ec6-35d5-4ea8-b232-90151e986b08</uuid>
Nov 14 07:00:14 user nova-compute[75354]:   <name>instance-00000029</name>
Nov 14 07:00:14 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:00:14 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:00:14 user nova-compute[75354]:   <metadata>
Nov 14 07:00:14 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:00:14 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:00:14 user nova-compute[75354]:       <nova:name>tempest-VolumesActionsTest-instance-2114556554</nova:name>
Nov 14 07:00:14 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:00:13</nova:creationTime>
Nov 14 07:00:14 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:00:14 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:00:14 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:00:14 user nova-compute[75354]:       <nova:owner>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:user uuid="28e683728363464390df26c284fad546">tempest-VolumesActionsTest-1765535248-project-member</nova:user>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:project uuid="5933e720dc9e4cbcb4328fb33a4909c1">tempest-VolumesActionsTest-1765535248</nova:project>
Nov 14 07:00:14 user nova-compute[75354]:       </nova:owner>
Nov 14 07:00:14 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 07:00:14 user nova-compute[75354]:       <nova:ports>
Nov 14 07:00:14 user nova-compute[75354]:         <nova:port uuid="3e2abb56-c8fd-439c-8979-7f034c99ae53">
Nov 14 07:00:14 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 07:00:14 user nova-compute[75354]:         </nova:port>
Nov 14 07:00:14 user nova-compute[75354]:       </nova:ports>
Nov 14 07:00:14 user nova-compute[75354]:     </nova:instance>
Nov 14 07:00:14 user nova-compute[75354]:   </metadata>
Nov 14 07:00:14 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:00:14 user nova-compute[75354]:     <system>
Nov 14 07:00:14 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:00:14 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:00:14 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:00:14 user nova-compute[75354]:       <entry name="serial">80774ec6-35d5-4ea8-b232-90151e986b08</entry>
Nov 14 07:00:14 user nova-compute[75354]:       <entry name="uuid">80774ec6-35d5-4ea8-b232-90151e986b08</entry>
Nov 14 07:00:14 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:00:14 user nova-compute[75354]:     </system>
Nov 14 07:00:14 user nova-compute[75354]:   </sysinfo>
Nov 14 07:00:14 user nova-compute[75354]:   <os>
Nov 14 07:00:14 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:00:14 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:00:14 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:00:14 user nova-compute[75354]:   </os>
Nov 14 07:00:14 user nova-compute[75354]:   <features>
Nov 14 07:00:14 user nova-compute[75354]:     <acpi/>
Nov 14 07:00:14 user nova-compute[75354]:     <apic/>
Nov 14 07:00:14 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:00:14 user nova-compute[75354]:   </features>
Nov 14 07:00:14 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:00:14 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:00:14 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:00:14 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:00:14 user nova-compute[75354]:   </clock>
Nov 14 07:00:14 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:00:14 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:00:14 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:00:14 user nova-compute[75354]:   </cpu>
Nov 14 07:00:14 user nova-compute[75354]:   <devices>
Nov 14 07:00:14 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:00:14 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:00:14 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk"/>
Nov 14 07:00:14 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:00:14 user nova-compute[75354]:     </disk>
Nov 14 07:00:14 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:00:14 user nova-compute[75354]:       <mac address="fa:16:3e:2d:ba:bd"/>
Nov 14 07:00:14 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:00:14 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:00:14 user nova-compute[75354]:       <target dev="tap3e2abb56-c8"/>
Nov 14 07:00:14 user nova-compute[75354]:     </interface>
Nov 14 07:00:14 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:00:14 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/console.log" append="off"/>
Nov 14 07:00:14 user nova-compute[75354]:     </serial>
Nov 14 07:00:14 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:00:14 user nova-compute[75354]:     <video>
Nov 14 07:00:14 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:00:14 user nova-compute[75354]:     </video>
Nov 14 07:00:14 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:00:14 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:00:14 user nova-compute[75354]:     </rng>
Nov 14 07:00:14 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:00:14 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:00:14 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:00:14 user nova-compute[75354]:     </memballoon>
Nov 14 07:00:14 user nova-compute[75354]:   </devices>
Nov 14 07:00:14 user nova-compute[75354]: </domain>
Nov 14 07:00:14 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2114556554',display_name='tempest-VolumesActionsTest-instance-2114556554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2114556554',id=41,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5933e720dc9e4cbcb4328fb33a4909c1',ramdisk_id='',reservation_id='r-9wbenlgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1765535248',owner_user_name='tempest-VolumesActionsTest-1765535248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:00:12Z,user_data=None,user_id='28e683728363464390df26c284fad546',uuid=80774ec6-35d5-4ea8-b232-90151e986b08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converting VIF {"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG os_vif [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcccb2a0-5461-5d65-ba6a-20b1d15dcc2c', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e2abb56-c8, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e2abb56-c8, col_values=(('qos', UUID('d96ca929-5d10-4620-8ba4-1635de39c9b3')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e2abb56-c8, col_values=(('external_ids', {'iface-id': '3e2abb56-c8fd-439c-8979-7f034c99ae53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:ba:bd', 'vm-uuid': '80774ec6-35d5-4ea8-b232-90151e986b08'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: INFO os_vif [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8')
Nov 14 07:00:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] No VIF found with MAC fa:16:3e:2d:ba:bd, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.neutron [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Updated VIF entry in instance network info cache for port 3e2abb56-c8fd-439c-8979-7f034c99ae53. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.neutron [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Updating instance_info_cache with network_info: [{"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1d7a4cee-b02f-4977-bca4-bf0640dcf81f req-c3730d42-094e-46f6-bd0d-22d05d43b022 service nova] Releasing lock "refresh_cache-80774ec6-35d5-4ea8-b232-90151e986b08" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.neutron [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Successfully updated port: 55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "refresh_cache-a937fbc5-ea50-407d-b132-2754c4b0b241" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquired lock "refresh_cache-a937fbc5-ea50-407d-b132-2754c4b0b241" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.network.neutron [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-changed-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Refreshing instance network info cache due to event network-changed-55fa8f58-47b1-44d8-920e-1d1dfbaa342b. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:00:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] Acquiring lock "refresh_cache-a937fbc5-ea50-407d-b132-2754c4b0b241" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Updating instance_info_cache with network_info: [{"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Releasing lock "refresh_cache-a937fbc5-ea50-407d-b132-2754c4b0b241" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Instance network_info: |[{"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] Acquired lock "refresh_cache-a937fbc5-ea50-407d-b132-2754c4b0b241" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Refreshing network info cache for port 55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Updated VIF entry in instance network info cache for port 55fa8f58-47b1-44d8-920e-1d1dfbaa342b. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Updating instance_info_cache with network_info: [{"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef04d346-a530-4db4-84bb-66781b913a73 req-44e06d62-a41d-4ce5-a582-b4e4bcb02ef8 service nova] Releasing lock "refresh_cache-a937fbc5-ea50-407d-b132-2754c4b0b241" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] No waiting events found dispatching network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:00:17 user nova-compute[75354]: WARNING nova.compute.manager [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received unexpected event network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 for instance with vm_state building and task_state spawning.
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] No waiting events found dispatching network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:00:17 user nova-compute[75354]: WARNING nova.compute.manager [req-c523da07-ac60-46a3-84c2-20c174b67b96 req-c93ff69d-816b-4d38-adeb-62881dd67686 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received unexpected event network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 for instance with vm_state building and task_state spawning.
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:00:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Instance spawned successfully.
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:17 user nova-compute[75354]: INFO nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 14 07:00:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:00:17 user nova-compute[75354]: INFO nova.compute.manager [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Took 5.80 seconds to build instance.
Nov 14 07:00:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6f4714a3-786a-4921-9a01-d55a1279a08a tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "80774ec6-35d5-4ea8-b232-90151e986b08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.923s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG os_brick.utils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b5fad-7603-49c5-9c11-0bdade7f25a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d82fe9-37a7-4b4d-a0ab-21c348e18cfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a3026a-75c7-441a-806b-5053845a070b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[996c5339-95d6-4153-b7d7-f688c9d77519]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:00:18 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:00:18 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[78849249-7093-4e07-ba2d-1435bd6d2b39]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG os_brick.utils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:00:18 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Updating existing volume attachment record: 040a38a9-1c26-4a0b-ba17-2293c31992ac {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:00:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:00:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Creating image(s)
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Ensure instance console log exists: /opt/stack/data/nova/instances/a937fbc5-ea50-407d-b132-2754c4b0b241/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Start _get_guest_xml network_info=[{"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNqcQtJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a937fbc5-ea50-407d-b132-2754c4b0b241', 'attached_at': '', 'detached_at': '', 'volume_id': '6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c', 'serial': '6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '040a38a9-1c26-4a0b-ba17-2293c31992ac', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:00:23 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:00:23 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNqcQtJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:00:23 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:00:23 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:00:23 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e28285-8cf9-46b8-824b-4b9574cda284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:00:23 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cbdf74-7d23-4682-854a-60b70d88a08f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c] added
Nov 14 07:00:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a272d9-dfdf-4c86-b1fd-283fe7223e49]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e525f0-dd5f-4762-8261-b8afc1e4c1ec]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNqcQtJU {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNqcQtJU" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a950ae-dbf1-4407-abad-b1985a43d569]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNqcQtJU'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2da91-df2e-43b1-b645-cfc218c3f6d9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf5017-be56-440d-bd5d-4ca0ed80d2ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:00:23 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:00:23 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:00:23 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:00:23 user nova-compute[75354]: 
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1078f-52ca-470b-ad20-a82fb185fa5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260]
Nov 14 07:00:23 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260] successful.
Nov 14 07:00:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82446f18-e3a7-4cf0-879f-8b6e383e1c6d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c6f609-9305-4897-8968-020f9a4d9be4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:00:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:00:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.144s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc5458d-00ca-4bba-ad37-4d828c134ad6]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:00:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNqcQtJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23733323636303532', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733323636303532', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-359756579',display_name='tempest-TestVolumeBootPattern-server-359756579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-359756579',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-boam1kup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:00:13Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=a937fbc5-ea50-407d-b132-2754c4b0b241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'pci_devices' on Instance uuid a937fbc5-ea50-407d-b132-2754c4b0b241 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:00:24 user nova-compute[75354]:   <uuid>a937fbc5-ea50-407d-b132-2754c4b0b241</uuid>
Nov 14 07:00:24 user nova-compute[75354]:   <name>instance-0000002a</name>
Nov 14 07:00:24 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:00:24 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:00:24 user nova-compute[75354]:   <metadata>
Nov 14 07:00:24 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:00:24 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:00:24 user nova-compute[75354]:       <nova:name>tempest-TestVolumeBootPattern-server-359756579</nova:name>
Nov 14 07:00:24 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:00:23</nova:creationTime>
Nov 14 07:00:24 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:00:24 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:00:24 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:00:24 user nova-compute[75354]:       <nova:owner>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:user uuid="31f9b73f37fb4801aa39ff23e1a095cc">tempest-TestVolumeBootPattern-1643565198-project-member</nova:user>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:project uuid="7c9131ea3f6241aead77fcf82f1e8000">tempest-TestVolumeBootPattern-1643565198</nova:project>
Nov 14 07:00:24 user nova-compute[75354]:       </nova:owner>
Nov 14 07:00:24 user nova-compute[75354]:       <nova:ports>
Nov 14 07:00:24 user nova-compute[75354]:         <nova:port uuid="55fa8f58-47b1-44d8-920e-1d1dfbaa342b">
Nov 14 07:00:24 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 07:00:24 user nova-compute[75354]:         </nova:port>
Nov 14 07:00:24 user nova-compute[75354]:       </nova:ports>
Nov 14 07:00:24 user nova-compute[75354]:     </nova:instance>
Nov 14 07:00:24 user nova-compute[75354]:   </metadata>
Nov 14 07:00:24 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:00:24 user nova-compute[75354]:     <system>
Nov 14 07:00:24 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:00:24 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:00:24 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:00:24 user nova-compute[75354]:       <entry name="serial">a937fbc5-ea50-407d-b132-2754c4b0b241</entry>
Nov 14 07:00:24 user nova-compute[75354]:       <entry name="uuid">a937fbc5-ea50-407d-b132-2754c4b0b241</entry>
Nov 14 07:00:24 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:00:24 user nova-compute[75354]:     </system>
Nov 14 07:00:24 user nova-compute[75354]:   </sysinfo>
Nov 14 07:00:24 user nova-compute[75354]:   <os>
Nov 14 07:00:24 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:00:24 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:00:24 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:00:24 user nova-compute[75354]:   </os>
Nov 14 07:00:24 user nova-compute[75354]:   <features>
Nov 14 07:00:24 user nova-compute[75354]:     <acpi/>
Nov 14 07:00:24 user nova-compute[75354]:     <apic/>
Nov 14 07:00:24 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:00:24 user nova-compute[75354]:   </features>
Nov 14 07:00:24 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:00:24 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:00:24 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:00:24 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:00:24 user nova-compute[75354]:   </clock>
Nov 14 07:00:24 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:00:24 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:00:24 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:00:24 user nova-compute[75354]:   </cpu>
Nov 14 07:00:24 user nova-compute[75354]:   <devices>
Nov 14 07:00:24 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:00:24 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:00:24 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 07:00:24 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:00:24 user nova-compute[75354]:       <serial>6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c</serial>
Nov 14 07:00:24 user nova-compute[75354]:     </disk>
Nov 14 07:00:24 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:00:24 user nova-compute[75354]:       <mac address="fa:16:3e:ea:32:87"/>
Nov 14 07:00:24 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:00:24 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:00:24 user nova-compute[75354]:       <target dev="tap55fa8f58-47"/>
Nov 14 07:00:24 user nova-compute[75354]:     </interface>
Nov 14 07:00:24 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:00:24 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/a937fbc5-ea50-407d-b132-2754c4b0b241/console.log" append="off"/>
Nov 14 07:00:24 user nova-compute[75354]:     </serial>
Nov 14 07:00:24 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:00:24 user nova-compute[75354]:     <video>
Nov 14 07:00:24 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:00:24 user nova-compute[75354]:     </video>
Nov 14 07:00:24 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:00:24 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:00:24 user nova-compute[75354]:     </rng>
Nov 14 07:00:24 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:00:24 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:00:24 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:00:24 user nova-compute[75354]:     </memballoon>
Nov 14 07:00:24 user nova-compute[75354]:   </devices>
Nov 14 07:00:24 user nova-compute[75354]: </domain>
Nov 14 07:00:24 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-359756579',display_name='tempest-TestVolumeBootPattern-server-359756579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-359756579',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-boam1kup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:00:13Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=a937fbc5-ea50-407d-b132-2754c4b0b241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG os_vif [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e458ff9d-d454-5e39-92b4-33618e2f1521', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55fa8f58-47, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55fa8f58-47, col_values=(('qos', UUID('9f47abca-2626-4145-91cd-3e3ee8c186da')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55fa8f58-47, col_values=(('external_ids', {'iface-id': '55fa8f58-47b1-44d8-920e-1d1dfbaa342b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:32:87', 'vm-uuid': 'a937fbc5-ea50-407d-b132-2754c4b0b241'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:24 user nova-compute[75354]: INFO os_vif [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47')
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:00:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No VIF found with MAC fa:16:3e:ea:32:87, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-d5d39895-961e-434d-9ef9-475fe136840c req-a2a3c344-4d89-45a5-9f3d-30079436f1e5 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d5d39895-961e-434d-9ef9-475fe136840c req-a2a3c344-4d89-45a5-9f3d-30079436f1e5 service nova] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d5d39895-961e-434d-9ef9-475fe136840c req-a2a3c344-4d89-45a5-9f3d-30079436f1e5 service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d5d39895-961e-434d-9ef9-475fe136840c req-a2a3c344-4d89-45a5-9f3d-30079436f1e5 service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-d5d39895-961e-434d-9ef9-475fe136840c req-a2a3c344-4d89-45a5-9f3d-30079436f1e5 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] No waiting events found dispatching network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:00:26 user nova-compute[75354]: WARNING nova.compute.manager [req-d5d39895-961e-434d-9ef9-475fe136840c req-a2a3c344-4d89-45a5-9f3d-30079436f1e5 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received unexpected event network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b for instance with vm_state building and task_state spawning.
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:00:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Instance spawned successfully.
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:00:28 user nova-compute[75354]: INFO nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-4c0c9a94-86b6-43af-a51f-018c39c29e55 req-35795ea2-da5a-46ff-9a0c-7d08d206e484 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4c0c9a94-86b6-43af-a51f-018c39c29e55 req-35795ea2-da5a-46ff-9a0c-7d08d206e484 service nova] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4c0c9a94-86b6-43af-a51f-018c39c29e55 req-35795ea2-da5a-46ff-9a0c-7d08d206e484 service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4c0c9a94-86b6-43af-a51f-018c39c29e55 req-35795ea2-da5a-46ff-9a0c-7d08d206e484 service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-4c0c9a94-86b6-43af-a51f-018c39c29e55 req-35795ea2-da5a-46ff-9a0c-7d08d206e484 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] No waiting events found dispatching network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:00:28 user nova-compute[75354]: WARNING nova.compute.manager [req-4c0c9a94-86b6-43af-a51f-018c39c29e55 req-35795ea2-da5a-46ff-9a0c-7d08d206e484 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received unexpected event network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b for instance with vm_state building and task_state spawning.
Nov 14 07:00:28 user nova-compute[75354]: INFO nova.compute.manager [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Took 16.36 seconds to build instance.
Nov 14 07:00:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-01f12eca-97d8-457c-8257-2558dd79b056 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.455s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-changed-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Refreshing instance network info cache due to event network-changed-b6e1dcde-d382-483a-9ab6-74f443246e78. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] Acquiring lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] Acquired lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Refreshing network info cache for port b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updated VIF entry in instance network info cache for port b6e1dcde-d382-483a-9ab6-74f443246e78. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating instance_info_cache with network_info: [{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2ca33dd4-5225-4da8-a001-b7dfc398a716 req-4d02c6a4-aa88-4775-9faf-dfe308c037ec service nova] Releasing lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:00:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:00:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:47 user nova-compute[75354]: INFO nova.compute.manager [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Attaching volume 3238be17-ce45-4d5b-a1b2-aac22fbe38e3 to /dev/vdb
Nov 14 07:00:47 user nova-compute[75354]: DEBUG os_brick.utils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7687ec8-627a-41b7-914c-edbbc5fa0e90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecdb53c-88f6-4709-9126-0dbb8c6fea72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d5aac-e0bb-4b33-aa9f-531071146641]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3946ebc-2321-48cb-b4d2-cd882f0e3e9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:00:47 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:00:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e7b3a-e2da-4384-b3b8-beeb44e05fb1]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG os_brick.utils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:00:47 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating existing volume attachment record: 44c6c165-b2eb-4f6d-92ad-9e1c2318ed86 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:00:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIBcCbiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:00:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:00:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:00:51 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9bf2c-fb79-4290-b5f9-d07dbda436db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:00:51 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eadcedc-9c79-4133-8643-a475596d9035]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3] added
Nov 14 07:00:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f2264-10a0-4c0b-8fe5-013e641a9542]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaade70-ac36-45ba-90a9-d615f992505c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIBcCbiG {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIBcCbiG" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[817eb394-2f74-4ac4-9cdb-ff7485bb921d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TIBcCbiG'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb99a096-6e51-413e-b715-2067e356ac39]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f99d7-0e8d-4d7e-b3e5-a9d1952efd52]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:00:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:00:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730d0de-16b3-466d-8f15-10e74e0ef0d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260]
Nov 14 07:00:51 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260] successful.
Nov 14 07:00:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb8c48-ffad-4577-a6e2-0d860ec560d9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea72e68-13c1-4a46-beac-21dd50566197]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:00:51 user nova-compute[75354]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 (non-flash)
Nov 14 07:00:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:00:51 user nova-compute[75354]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 (non-flash)
Nov 14 07:00:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b230062-824d-45bc-acdc-7ba6fee6352e]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:00:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIBcCbiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:00:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:00:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26638306133613232', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:00:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638306133613232', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:00:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:00:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:00:52 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:00:52 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 07:00:52 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:00:52 user nova-compute[75354]:   <serial>3238be17-ce45-4d5b-a1b2-aac22fbe38e3</serial>
Nov 14 07:00:52 user nova-compute[75354]: </disk>
Nov 14 07:00:52 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] No VIF found with MAC fa:16:3e:5e:ab:f0, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8edfcafd-ba93-447c-92a3-9161dae3a89f tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.048s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:53 user nova-compute[75354]: INFO nova.compute.manager [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Detaching volume 3238be17-ce45-4d5b-a1b2-aac22fbe38e3
Nov 14 07:00:53 user nova-compute[75354]: INFO nova.virt.block_device [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Attempting to driver detach volume 3238be17-ce45-4d5b-a1b2-aac22fbe38e3 from mountpoint /dev/vdb
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Attempting to detach device vdb from instance 7430b806-60c9-441c-95cc-3e95c63575be from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:00:53 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:00:53 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 07:00:53 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:00:53 user nova-compute[75354]:   <serial>3238be17-ce45-4d5b-a1b2-aac22fbe38e3</serial>
Nov 14 07:00:53 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:00:53 user nova-compute[75354]: </disk>
Nov 14 07:00:53 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:00:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully detached device vdb from instance 7430b806-60c9-441c-95cc-3e95c63575be from the persistent domain config.
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7430b806-60c9-441c-95cc-3e95c63575be from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:00:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:00:53 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:00:53 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 07:00:53 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:00:53 user nova-compute[75354]:   <serial>3238be17-ce45-4d5b-a1b2-aac22fbe38e3</serial>
Nov 14 07:00:53 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:00:53 user nova-compute[75354]: </disk>
Nov 14 07:00:53 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:00:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:00:55 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.292762756347656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 7430b806-60c9-441c-95cc-3e95c63575be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 80774ec6-35d5-4ea8-b232-90151e986b08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a937fbc5-ea50-407d-b132-2754c4b0b241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:00:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:00:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:00:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:00:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:00:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating instance_info_cache with network_info: [{"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-7430b806-60c9-441c-95cc-3e95c63575be" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:01:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 07:01:14 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7430b806-60c9-441c-95cc-3e95c63575be is timed out.
Nov 14 07:01:14 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully detached device vdb from instance 7430b806-60c9-441c-95cc-3e95c63575be from the live domain config.
Nov 14 07:01:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIBcCbiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:01:14 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc4e8a-c4c4-4f2e-ac3f-bfc699fbdaa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:01:14 user nova-compute[75354]: No targets found.
Nov 14 07:01:14 user nova-compute[75354]: iSNS:
Nov 14 07:01:14 user nova-compute[75354]: No targets found.
Nov 14 07:01:14 user nova-compute[75354]: STATIC:
Nov 14 07:01:14 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c
Nov 14 07:01:14 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:01:14 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:01:14 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3
Nov 14 07:01:14 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:01:14 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:01:14 user nova-compute[75354]: FIRMWARE:
Nov 14 07:01:14 user nova-compute[75354]: No targets found.
Nov 14 07:01:14 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:01:14 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:01:14 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d4428-44a0-450d-bc64-b7ba729a6c7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1389cb-1eef-4419-8225-9462fb279746]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:01:14 user nova-compute[75354]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 (non-flash)
Nov 14 07:01:14 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:01:14 user nova-compute[75354]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 (non-flash)
Nov 14 07:01:14 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80742ac040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8a2608-3deb-4ecc-bb9c-5611b27cf24f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b1aec-e3d9-4677-a1a3-128aed8c5db6]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[799122ab-8393-435a-b67b-6364fc881dde]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c12fd-2284-4c14-a39d-5ecb9ab134bf]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e34b4d-e0a1-46f4-b0fb-03426a32b38f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e57ed5-2015-49ef-8382-f590c2712e32]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260]
Nov 14 07:01:14 user nova-compute[75354]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3, portal: 172.16.0.220,3260] successful.
Nov 14 07:01:14 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3238be17-ce45-4d5b-a1b2-aac22fbe38e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd813726-e274-4da3-a656-0c47a5fb9e2c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] <== disconnect_volume: return (328ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:01:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:15 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'flavor' on Instance uuid 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:01:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a5b9cc45-fc61-4612-85a5-1902f1a1e0b0 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:01:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:01:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:01:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:01:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:44 user nova-compute[75354]: INFO nova.compute.manager [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Terminating instance
Nov 14 07:01:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-e4faa690-c842-421e-b99a-e49f4dcd257c req-bb4d731e-2ece-48df-b77f-0d3d770584d9 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-vif-unplugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e4faa690-c842-421e-b99a-e49f4dcd257c req-bb4d731e-2ece-48df-b77f-0d3d770584d9 service nova] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e4faa690-c842-421e-b99a-e49f4dcd257c req-bb4d731e-2ece-48df-b77f-0d3d770584d9 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e4faa690-c842-421e-b99a-e49f4dcd257c req-bb4d731e-2ece-48df-b77f-0d3d770584d9 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-e4faa690-c842-421e-b99a-e49f4dcd257c req-bb4d731e-2ece-48df-b77f-0d3d770584d9 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] No waiting events found dispatching network-vif-unplugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-e4faa690-c842-421e-b99a-e49f4dcd257c req-bb4d731e-2ece-48df-b77f-0d3d770584d9 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-vif-unplugged-b6e1dcde-d382-483a-9ab6-74f443246e78 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Instance destroyed successfully.
Nov 14 07:01:44 user nova-compute[75354]: DEBUG nova.objects.instance [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lazy-loading 'resources' on Instance uuid 7430b806-60c9-441c-95cc-3e95c63575be {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T06:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-300686613',display_name='tempest-AttachVolumeNegativeTest-server-300686613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-300686613',id=40,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBImlT3uUj09lY5dL1MfnZwThBe7fEw0+z4qLLMGJeK6Cupx6bHRuInghcdnfxYK8psfCWMKyDdNQzwtunIbeQrHATtfdTirIyWNE64rMNNcWJMZZt4DXi/Uaghy0snBPQ==',key_name='tempest-keypair-804225848',keypairs=<?>,launch_index=0,launched_at=2023-11-14T06:58:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930e51c7a6574779985bacd62c89cdf6',ramdisk_id='',reservation_id='r-7oc4azx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-365177810',owner_user_name='tempest-AttachVolumeNegativeTest-365177810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T06:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a633fa123bb74524b360106dc68456b5',uuid=7430b806-60c9-441c-95cc-3e95c63575be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converting VIF {"id": "b6e1dcde-d382-483a-9ab6-74f443246e78", "address": "fa:16:3e:5e:ab:f0", "network": {"id": "2348a967-29f2-43fd-9817-f7a1c929a689", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1746705552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930e51c7a6574779985bacd62c89cdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e1dcde-d3", "ovs_interfaceid": "b6e1dcde-d382-483a-9ab6-74f443246e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG os_vif [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6e1dcde-d3, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=613406be-4c20-4258-9202-dd0281b61889) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:01:45 user nova-compute[75354]: INFO os_vif [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ab:f0,bridge_name='br-int',has_traffic_filtering=True,id=b6e1dcde-d382-483a-9ab6-74f443246e78,network=Network(2348a967-29f2-43fd-9817-f7a1c929a689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e1dcde-d3')
Nov 14 07:01:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Deleting instance files /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be_del
Nov 14 07:01:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Deletion of /opt/stack/data/nova/instances/7430b806-60c9-441c-95cc-3e95c63575be_del complete
Nov 14 07:01:45 user nova-compute[75354]: INFO nova.compute.manager [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 07:01:45 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:01:45 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Took 0.68 seconds to deallocate network for instance.
Nov 14 07:01:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-7b96a1d9-8da9-4149-a20f-51ea03a87e52 req-95c23d29-ac5e-4847-8f83-1421c40a3dee service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-vif-deleted-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:01:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:46 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Deleted allocations for instance 7430b806-60c9-441c-95cc-3e95c63575be
Nov 14 07:01:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-8cec9e4d-97f5-47fb-85ca-79fdcad87208 tempest-AttachVolumeNegativeTest-365177810 tempest-AttachVolumeNegativeTest-365177810-project-member] Lock "7430b806-60c9-441c-95cc-3e95c63575be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.844s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-f6469085-ea84-4fe2-8077-a87057f4a901 req-760013d7-9f72-4739-904b-a90ad06052d4 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received event network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:01:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f6469085-ea84-4fe2-8077-a87057f4a901 req-760013d7-9f72-4739-904b-a90ad06052d4 service nova] Acquiring lock "7430b806-60c9-441c-95cc-3e95c63575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f6469085-ea84-4fe2-8077-a87057f4a901 req-760013d7-9f72-4739-904b-a90ad06052d4 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f6469085-ea84-4fe2-8077-a87057f4a901 req-760013d7-9f72-4739-904b-a90ad06052d4 service nova] Lock "7430b806-60c9-441c-95cc-3e95c63575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-f6469085-ea84-4fe2-8077-a87057f4a901 req-760013d7-9f72-4739-904b-a90ad06052d4 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] No waiting events found dispatching network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:01:46 user nova-compute[75354]: WARNING nova.compute.manager [req-f6469085-ea84-4fe2-8077-a87057f4a901 req-760013d7-9f72-4739-904b-a90ad06052d4 service nova] [instance: 7430b806-60c9-441c-95cc-3e95c63575be] Received unexpected event network-vif-plugged-b6e1dcde-d382-483a-9ab6-74f443246e78 for instance with vm_state deleted and task_state None.
Nov 14 07:01:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:01:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:01:55 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:01:56 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:01:56 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:01:56 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.319839477539062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:01:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 80774ec6-35d5-4ea8-b232-90151e986b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance a937fbc5-ea50-407d-b132-2754c4b0b241 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:01:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:01:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:01:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:02:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "80774ec6-35d5-4ea8-b232-90151e986b08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:02 user nova-compute[75354]: INFO nova.compute.manager [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Terminating instance
Nov 14 07:02:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-a256682a-77b0-4992-b42e-5c2368c0a0b9 req-e9851a65-319c-4910-9b5d-728ce6985520 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-vif-unplugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a256682a-77b0-4992-b42e-5c2368c0a0b9 req-e9851a65-319c-4910-9b5d-728ce6985520 service nova] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a256682a-77b0-4992-b42e-5c2368c0a0b9 req-e9851a65-319c-4910-9b5d-728ce6985520 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a256682a-77b0-4992-b42e-5c2368c0a0b9 req-e9851a65-319c-4910-9b5d-728ce6985520 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-a256682a-77b0-4992-b42e-5c2368c0a0b9 req-e9851a65-319c-4910-9b5d-728ce6985520 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] No waiting events found dispatching network-vif-unplugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:02:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-a256682a-77b0-4992-b42e-5c2368c0a0b9 req-e9851a65-319c-4910-9b5d-728ce6985520 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-vif-unplugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Instance destroyed successfully.
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.objects.instance [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lazy-loading 'resources' on Instance uuid 80774ec6-35d5-4ea8-b232-90151e986b08 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2114556554',display_name='tempest-VolumesActionsTest-instance-2114556554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2114556554',id=41,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5933e720dc9e4cbcb4328fb33a4909c1',ramdisk_id='',reservation_id='r-9wbenlgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1765535248',owner_user_name='tempest-VolumesActionsTest-1765535248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:00:18Z,user_data=None,user_id='28e683728363464390df26c284fad546',uuid=80774ec6-35d5-4ea8-b232-90151e986b08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converting VIF {"id": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "address": "fa:16:3e:2d:ba:bd", "network": {"id": "1221aad4-0aff-4393-9efa-65810f11e1fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598469998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5933e720dc9e4cbcb4328fb33a4909c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2abb56-c8", "ovs_interfaceid": "3e2abb56-c8fd-439c-8979-7f034c99ae53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG os_vif [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Skipping network cache update for instance because it is being deleted. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e2abb56-c8, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d96ca929-5d10-4620-8ba4-1635de39c9b3) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:02:03 user nova-compute[75354]: INFO os_vif [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ba:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e2abb56-c8fd-439c-8979-7f034c99ae53,network=Network(1221aad4-0aff-4393-9efa-65810f11e1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2abb56-c8')
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Deleting instance files /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08_del
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Deletion of /opt/stack/data/nova/instances/80774ec6-35d5-4ea8-b232-90151e986b08_del complete
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Skipping network cache update for instance because it is being deleted. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.compute.manager [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Terminating instance
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.compute.manager [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Took 0.48 seconds to deallocate network for instance.
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-605a74ad-643d-42ff-96c0-a65cfda6b351 req-fc46632f-43d3-4796-a911-dedc78a8026a service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-vif-unplugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-605a74ad-643d-42ff-96c0-a65cfda6b351 req-fc46632f-43d3-4796-a911-dedc78a8026a service nova] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-605a74ad-643d-42ff-96c0-a65cfda6b351 req-fc46632f-43d3-4796-a911-dedc78a8026a service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-605a74ad-643d-42ff-96c0-a65cfda6b351 req-fc46632f-43d3-4796-a911-dedc78a8026a service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-605a74ad-643d-42ff-96c0-a65cfda6b351 req-fc46632f-43d3-4796-a911-dedc78a8026a service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] No waiting events found dispatching network-vif-unplugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-605a74ad-643d-42ff-96c0-a65cfda6b351 req-fc46632f-43d3-4796-a911-dedc78a8026a service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-vif-unplugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Deleted allocations for instance 80774ec6-35d5-4ea8-b232-90151e986b08
Nov 14 07:02:03 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Instance destroyed successfully.
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.objects.instance [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'resources' on Instance uuid a937fbc5-ea50-407d-b132-2754c4b0b241 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-359756579',display_name='tempest-TestVolumeBootPattern-server-359756579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-359756579',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-boam1kup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:00:29Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=a937fbc5-ea50-407d-b132-2754c4b0b241,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "address": "fa:16:3e:ea:32:87", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fa8f58-47", "ovs_interfaceid": "55fa8f58-47b1-44d8-920e-1d1dfbaa342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG os_vif [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55fa8f58-47, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f47abca-2626-4145-91cd-3e3ee8c186da) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:02:03 user nova-compute[75354]: INFO os_vif [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:32:87,bridge_name='br-int',has_traffic_filtering=True,id=55fa8f58-47b1-44d8-920e-1d1dfbaa342b,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fa8f58-47')
Nov 14 07:02:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNqcQtJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:02:03 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:02:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:02:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a325f3f4-2a6a-4e92-a4d5-9aa774ddf930]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:02:04 user nova-compute[75354]: No targets found.
Nov 14 07:02:04 user nova-compute[75354]: iSNS:
Nov 14 07:02:04 user nova-compute[75354]: No targets found.
Nov 14 07:02:04 user nova-compute[75354]: STATIC:
Nov 14 07:02:04 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c
Nov 14 07:02:04 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:02:04 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:02:04 user nova-compute[75354]: FIRMWARE:
Nov 14 07:02:04 user nova-compute[75354]: No targets found.
Nov 14 07:02:04 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:02:04 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:02:04 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-706744b7-77c4-44f6-8dc2-88eb68e1e9a5 tempest-VolumesActionsTest-1765535248 tempest-VolumesActionsTest-1765535248-project-member] Lock "80774ec6-35d5-4ea8-b232-90151e986b08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.664s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bff0f4-2797-482d-90ae-d697fa9f0355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7d09f-dbe9-4396-8292-1e4fd7925b3d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:02:04 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c (non-flash)
Nov 14 07:02:04 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741c2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf39c06-6126-46df-a1a0-71fc7f5a5c52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb565420-4102-42bd-8f7e-57a42dfaf2ca]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[813689d8-041a-4c1a-83f8-4f470e600e48]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee08e3-28a0-4e0b-9b33-ac3786f8635e]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3b159-5915-4755-98ce-1d7c0cbef3c4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5365d2-fb91-4231-a35d-cf1affe5b44d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260]
Nov 14 07:02:04 user nova-compute[75354]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c, portal: 172.16.0.220,3260] successful.
Nov 14 07:02:04 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7162775e-0b26-4c86-81fe-115139304a80]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== disconnect_volume: return (270ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:02:04 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Deleting instance files /opt/stack/data/nova/instances/a937fbc5-ea50-407d-b132-2754c4b0b241_del
Nov 14 07:02:04 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Deletion of /opt/stack/data/nova/instances/a937fbc5-ea50-407d-b132-2754c4b0b241_del complete
Nov 14 07:02:04 user nova-compute[75354]: INFO nova.compute.manager [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] Acquiring lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] Lock "80774ec6-35d5-4ea8-b232-90151e986b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] No waiting events found dispatching network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:02:04 user nova-compute[75354]: WARNING nova.compute.manager [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received unexpected event network-vif-plugged-3e2abb56-c8fd-439c-8979-7f034c99ae53 for instance with vm_state deleted and task_state None.
Nov 14 07:02:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-8837777a-31cb-4e0a-b09a-87b62040b836 req-68ede8d2-a98f-4e57-9749-3b482a0a7521 service nova] [instance: 80774ec6-35d5-4ea8-b232-90151e986b08] Received event network-vif-deleted-3e2abb56-c8fd-439c-8979-7f034c99ae53 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:02:04 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Took 0.44 seconds to deallocate network for instance.
Nov 14 07:02:05 user nova-compute[75354]: INFO nova.compute.manager [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 07:02:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Deleting volume: 6bfb236c-ffa0-4168-8dcc-ec7ccbb3b79c {{(pid=75354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:05 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Deleted allocations for instance a937fbc5-ea50-407d-b132-2754c4b0b241
Nov 14 07:02:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-39ec3926-0e4f-4be9-9d5d-8a0418ec730b req-8c973a8a-3392-42af-bc93-19eb14f7b10d service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-39ec3926-0e4f-4be9-9d5d-8a0418ec730b req-8c973a8a-3392-42af-bc93-19eb14f7b10d service nova] Acquiring lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-39ec3926-0e4f-4be9-9d5d-8a0418ec730b req-8c973a8a-3392-42af-bc93-19eb14f7b10d service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-39ec3926-0e4f-4be9-9d5d-8a0418ec730b req-8c973a8a-3392-42af-bc93-19eb14f7b10d service nova] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-39ec3926-0e4f-4be9-9d5d-8a0418ec730b req-8c973a8a-3392-42af-bc93-19eb14f7b10d service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] No waiting events found dispatching network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:02:05 user nova-compute[75354]: WARNING nova.compute.manager [req-39ec3926-0e4f-4be9-9d5d-8a0418ec730b req-8c973a8a-3392-42af-bc93-19eb14f7b10d service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received unexpected event network-vif-plugged-55fa8f58-47b1-44d8-920e-1d1dfbaa342b for instance with vm_state deleted and task_state None.
Nov 14 07:02:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-de3a718a-f680-43be-ac47-97143e8ba06d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "a937fbc5-ea50-407d-b132-2754c4b0b241" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.620s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-5a57313e-f03b-4d1a-8bb9-dfd5f984ed6d req-4af5b9f9-1876-4476-a79b-40ed99721aa8 service nova] [instance: a937fbc5-ea50-407d-b132-2754c4b0b241] Received event network-vif-deleted-55fa8f58-47b1-44d8-920e-1d1dfbaa342b {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:02:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:09 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:02:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:02:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:02:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:57 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:02:58 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:02:58 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9085MB free_disk=25.329849243164062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:02:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:02:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:02 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:03:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:03:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:03:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:03:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:03:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:03:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:03:06 user nova-compute[75354]: INFO nova.compute.claims [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Claim successful on node user
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:03:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:03:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:03:06 user nova-compute[75354]: INFO nova.virt.block_device [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Booting with volume 420b3232-2a66-4089-9bed-5e80f29ef089 at /dev/vda
Nov 14 07:03:06 user nova-compute[75354]: DEBUG os_brick.utils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f9467-8dd4-4553-aa55-4981a90464d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb6b263-14f5-4972-b33d-92142e498041]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d69f88-32f2-43aa-956d-c0757c7bd753]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a9a5c-c41e-4183-a8bb-2d0efcdd528b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:03:07 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:03:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46ac53-6d2a-4a57-8dd1-d2b52a3cf03d]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG os_brick.utils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating existing volume attachment record: df6ad0d6-f161-4c5b-b59d-86f129f15476 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:03:07 user nova-compute[75354]: DEBUG nova.policy [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f9b73f37fb4801aa39ff23e1a095cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9131ea3f6241aead77fcf82f1e8000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:03:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Successfully created port: 75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:03:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Successfully updated port: 75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-changed-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Refreshing instance network info cache due to event network-changed-75717447-03f6-4d7e-9708-77fd0a0cba59. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] Acquiring lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] Acquired lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Refreshing network info cache for port 75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-23c0b859-fdf3-495b-8ed1-0b1ca59edb4b req-18a9a380-c942-403f-bc25-eda605d79aa4 service nova] Releasing lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquired lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:03:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Creating image(s)
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Ensure instance console log exists: /opt/stack/data/nova/instances/436cb3cb-d0df-49de-b99c-ead245d9376b/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [{"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Releasing lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Instance network_info: |[{"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Start _get_guest_xml network_info=[{"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTuqGeLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '436cb3cb-d0df-49de-b99c-ead245d9376b', 'attached_at': '', 'detached_at': '', 'volume_id': '420b3232-2a66-4089-9bed-5e80f29ef089', 'serial': '420b3232-2a66-4089-9bed-5e80f29ef089'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'df6ad0d6-f161-4c5b-b59d-86f129f15476', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:03:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:03:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTuqGeLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:03:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:03:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:03:11 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0047a77-dabb-4afc-a919-c187fb6f706f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:03:11 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4e7a3-a495-4e84-9cb4-7080df68c156]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089] added
Nov 14 07:03:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.065s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba03ba7-cc2e-496f-9f5e-1ea0db8da5c7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ea4a9-b4b4-4892-beca-e1877fd63a6a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTuqGeLC {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTuqGeLC" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0bf949-7c23-4643-a8f4-45dcbce83108]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yTuqGeLC'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634e176-5a67-4d82-b367-752d81be7115]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b26d4d-223c-4c5e-9bac-c4456113ef09]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c3b37bc-b9c6-4197-9424-c6c3b3bb3b03 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c3b37bc-b9c6-4197-9424-c6c3b3bb3b03 (non-flash)
Nov 14 07:03:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c3b37bc-b9c6-4197-9424-c6c3b3bb3b03 (non-flash)
Nov 14 07:03:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c0b10-cc14-43a4-9481-ccaae1d3c908]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260]
Nov 14 07:03:12 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260] successful.
Nov 14 07:03:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59726fa1-5d70-4888-b827-809c191e97dc]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4073b-f551-4719-bfcf-ebf61488c8b7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c3b37bc-b9c6-4197-9424-c6c3b3bb3b03 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c3b37bc-b9c6-4197-9424-c6c3b3bb3b03 (non-flash)
Nov 14 07:03:12 user nova-compute[75354]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:03:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c3b37bc-b9c6-4197-9424-c6c3b3bb3b03 (non-flash)
Nov 14 07:03:12 user nova-compute[75354]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:03:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c069db9-e3e3-483c-8ce8-3d2f0504a8b5]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:03:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTuqGeLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23535613233643031', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535613233643031', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1423913546',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1423913546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1423913546',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeb+S4JzHBDl0/OIKrdA174ZncV4mYJzZ+LbpLp+B5us9RWpZCUwEklR/2bTn1Ueo+EzMUd8JokTfbuvfUfNyz6HUrSm4hW53nvA1ysBWwwS9Puh5iAmfq+Jzn3BJOZvA==',key_name='tempest-keypair-743224293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-au27is6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=436cb3cb-d0df-49de-b99c-ead245d9376b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.objects.instance [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'pci_devices' on Instance uuid 436cb3cb-d0df-49de-b99c-ead245d9376b {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:03:13 user nova-compute[75354]:   <uuid>436cb3cb-d0df-49de-b99c-ead245d9376b</uuid>
Nov 14 07:03:13 user nova-compute[75354]:   <name>instance-0000002b</name>
Nov 14 07:03:13 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:03:13 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:03:13 user nova-compute[75354]:   <metadata>
Nov 14 07:03:13 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:03:13 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:03:13 user nova-compute[75354]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1423913546</nova:name>
Nov 14 07:03:13 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:03:11</nova:creationTime>
Nov 14 07:03:13 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:03:13 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:03:13 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:03:13 user nova-compute[75354]:       <nova:owner>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:user uuid="31f9b73f37fb4801aa39ff23e1a095cc">tempest-TestVolumeBootPattern-1643565198-project-member</nova:user>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:project uuid="7c9131ea3f6241aead77fcf82f1e8000">tempest-TestVolumeBootPattern-1643565198</nova:project>
Nov 14 07:03:13 user nova-compute[75354]:       </nova:owner>
Nov 14 07:03:13 user nova-compute[75354]:       <nova:ports>
Nov 14 07:03:13 user nova-compute[75354]:         <nova:port uuid="75717447-03f6-4d7e-9708-77fd0a0cba59">
Nov 14 07:03:13 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 07:03:13 user nova-compute[75354]:         </nova:port>
Nov 14 07:03:13 user nova-compute[75354]:       </nova:ports>
Nov 14 07:03:13 user nova-compute[75354]:     </nova:instance>
Nov 14 07:03:13 user nova-compute[75354]:   </metadata>
Nov 14 07:03:13 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:03:13 user nova-compute[75354]:     <system>
Nov 14 07:03:13 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:03:13 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:03:13 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:03:13 user nova-compute[75354]:       <entry name="serial">436cb3cb-d0df-49de-b99c-ead245d9376b</entry>
Nov 14 07:03:13 user nova-compute[75354]:       <entry name="uuid">436cb3cb-d0df-49de-b99c-ead245d9376b</entry>
Nov 14 07:03:13 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:03:13 user nova-compute[75354]:     </system>
Nov 14 07:03:13 user nova-compute[75354]:   </sysinfo>
Nov 14 07:03:13 user nova-compute[75354]:   <os>
Nov 14 07:03:13 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:03:13 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:03:13 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:03:13 user nova-compute[75354]:   </os>
Nov 14 07:03:13 user nova-compute[75354]:   <features>
Nov 14 07:03:13 user nova-compute[75354]:     <acpi/>
Nov 14 07:03:13 user nova-compute[75354]:     <apic/>
Nov 14 07:03:13 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:03:13 user nova-compute[75354]:   </features>
Nov 14 07:03:13 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:03:13 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:03:13 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:03:13 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:03:13 user nova-compute[75354]:   </clock>
Nov 14 07:03:13 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:03:13 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:03:13 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:03:13 user nova-compute[75354]:   </cpu>
Nov 14 07:03:13 user nova-compute[75354]:   <devices>
Nov 14 07:03:13 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:03:13 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:03:13 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 07:03:13 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:03:13 user nova-compute[75354]:       <serial>420b3232-2a66-4089-9bed-5e80f29ef089</serial>
Nov 14 07:03:13 user nova-compute[75354]:     </disk>
Nov 14 07:03:13 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:03:13 user nova-compute[75354]:       <mac address="fa:16:3e:4b:b5:71"/>
Nov 14 07:03:13 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:03:13 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:03:13 user nova-compute[75354]:       <target dev="tap75717447-03"/>
Nov 14 07:03:13 user nova-compute[75354]:     </interface>
Nov 14 07:03:13 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:03:13 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/436cb3cb-d0df-49de-b99c-ead245d9376b/console.log" append="off"/>
Nov 14 07:03:13 user nova-compute[75354]:     </serial>
Nov 14 07:03:13 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:03:13 user nova-compute[75354]:     <video>
Nov 14 07:03:13 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:03:13 user nova-compute[75354]:     </video>
Nov 14 07:03:13 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:03:13 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:03:13 user nova-compute[75354]:     </rng>
Nov 14 07:03:13 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:03:13 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:03:13 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:03:13 user nova-compute[75354]:     </memballoon>
Nov 14 07:03:13 user nova-compute[75354]:   </devices>
Nov 14 07:03:13 user nova-compute[75354]: </domain>
Nov 14 07:03:13 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1423913546',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1423913546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1423913546',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeb+S4JzHBDl0/OIKrdA174ZncV4mYJzZ+LbpLp+B5us9RWpZCUwEklR/2bTn1Ueo+EzMUd8JokTfbuvfUfNyz6HUrSm4hW53nvA1ysBWwwS9Puh5iAmfq+Jzn3BJOZvA==',key_name='tempest-keypair-743224293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-au27is6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=436cb3cb-d0df-49de-b99c-ead245d9376b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG os_vif [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6282ded-c49b-5d06-8ae2-f9d96062e31f', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75717447-03, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75717447-03, col_values=(('qos', UUID('2bbd74a0-a77a-4602-a6df-ad689f37e212')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75717447-03, col_values=(('external_ids', {'iface-id': '75717447-03f6-4d7e-9708-77fd0a0cba59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:b5:71', 'vm-uuid': '436cb3cb-d0df-49de-b99c-ead245d9376b'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:13 user nova-compute[75354]: INFO os_vif [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03')
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:03:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No VIF found with MAC fa:16:3e:4b:b5:71, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:03:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-b1876186-a2de-4db1-9374-ca77b6eaf8f3 req-401b4129-2ec2-4122-9aa8-8dd92f1116c4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b1876186-a2de-4db1-9374-ca77b6eaf8f3 req-401b4129-2ec2-4122-9aa8-8dd92f1116c4 service nova] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b1876186-a2de-4db1-9374-ca77b6eaf8f3 req-401b4129-2ec2-4122-9aa8-8dd92f1116c4 service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b1876186-a2de-4db1-9374-ca77b6eaf8f3 req-401b4129-2ec2-4122-9aa8-8dd92f1116c4 service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-b1876186-a2de-4db1-9374-ca77b6eaf8f3 req-401b4129-2ec2-4122-9aa8-8dd92f1116c4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] No waiting events found dispatching network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:03:15 user nova-compute[75354]: WARNING nova.compute.manager [req-b1876186-a2de-4db1-9374-ca77b6eaf8f3 req-401b4129-2ec2-4122-9aa8-8dd92f1116c4 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received unexpected event network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 for instance with vm_state building and task_state spawning.
Nov 14 07:03:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:03:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:03:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Instance spawned successfully.
Nov 14 07:03:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4186fa62-3a22-4703-b3af-e9d88ddc8b02 req-3ef67a1f-4cf2-4866-8119-c29bd1320f41 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4186fa62-3a22-4703-b3af-e9d88ddc8b02 req-3ef67a1f-4cf2-4866-8119-c29bd1320f41 service nova] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4186fa62-3a22-4703-b3af-e9d88ddc8b02 req-3ef67a1f-4cf2-4866-8119-c29bd1320f41 service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4186fa62-3a22-4703-b3af-e9d88ddc8b02 req-3ef67a1f-4cf2-4866-8119-c29bd1320f41 service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-4186fa62-3a22-4703-b3af-e9d88ddc8b02 req-3ef67a1f-4cf2-4866-8119-c29bd1320f41 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] No waiting events found dispatching network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:03:17 user nova-compute[75354]: WARNING nova.compute.manager [req-4186fa62-3a22-4703-b3af-e9d88ddc8b02 req-3ef67a1f-4cf2-4866-8119-c29bd1320f41 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received unexpected event network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 for instance with vm_state building and task_state spawning.
Nov 14 07:03:17 user nova-compute[75354]: INFO nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 14 07:03:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:03:17 user nova-compute[75354]: INFO nova.compute.manager [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Took 11.28 seconds to build instance.
Nov 14 07:03:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-27a4a6b7-3ecc-41ec-a63c-c1f2e90ca2d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.748s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:33 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:03:33 user nova-compute[75354]: INFO nova.compute.claims [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Claim successful on node user
Nov 14 07:03:33 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:03:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:03:34 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Creating image(s)
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "/opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "/opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "/opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.policy [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '459061efad1d4cab99a44fac0f53fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9d6ede73fc48918f60c2712a728791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.203s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk 1073741824" returned: 0 in 0.051s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Successfully created port: c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:03:34 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Cannot resize image /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Ensure instance console log exists: /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Successfully updated port: c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquired lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-changed-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Refreshing instance network info cache due to event network-changed-c54f0951-a2b4-4d56-bb7e-814747b7a338. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] Acquiring lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.neutron [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Updating instance_info_cache with network_info: [{"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Releasing lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Instance network_info: |[{"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] Acquired lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Refreshing network info cache for port c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Start _get_guest_xml network_info=[{"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:03:35 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:03:35 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1190076355',display_name='tempest-VolumesNegativeTest-instance-1190076355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1190076355',id=44,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c9d6ede73fc48918f60c2712a728791',ramdisk_id='',reservation_id='r-mlzysydd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1558083114',owner_user_name='tempest-VolumesNegativeTest-1558083114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:03:34Z,user_data=None,user_id='459061efad1d4cab99a44fac0f53fd54',uuid=81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Converting VIF {"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.objects.instance [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lazy-loading 'pci_devices' on Instance uuid 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:03:35 user nova-compute[75354]:   <uuid>81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f</uuid>
Nov 14 07:03:35 user nova-compute[75354]:   <name>instance-0000002c</name>
Nov 14 07:03:35 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:03:35 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:03:35 user nova-compute[75354]:   <metadata>
Nov 14 07:03:35 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:03:35 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:03:35 user nova-compute[75354]:       <nova:name>tempest-VolumesNegativeTest-instance-1190076355</nova:name>
Nov 14 07:03:35 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:03:35</nova:creationTime>
Nov 14 07:03:35 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:03:35 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:03:35 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:03:35 user nova-compute[75354]:       <nova:owner>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:user uuid="459061efad1d4cab99a44fac0f53fd54">tempest-VolumesNegativeTest-1558083114-project-member</nova:user>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:project uuid="4c9d6ede73fc48918f60c2712a728791">tempest-VolumesNegativeTest-1558083114</nova:project>
Nov 14 07:03:35 user nova-compute[75354]:       </nova:owner>
Nov 14 07:03:35 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 07:03:35 user nova-compute[75354]:       <nova:ports>
Nov 14 07:03:35 user nova-compute[75354]:         <nova:port uuid="c54f0951-a2b4-4d56-bb7e-814747b7a338">
Nov 14 07:03:35 user nova-compute[75354]:           <nova:ip type="fixed" address="192.168.233.148" ipVersion="4"/>
Nov 14 07:03:35 user nova-compute[75354]:         </nova:port>
Nov 14 07:03:35 user nova-compute[75354]:       </nova:ports>
Nov 14 07:03:35 user nova-compute[75354]:     </nova:instance>
Nov 14 07:03:35 user nova-compute[75354]:   </metadata>
Nov 14 07:03:35 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:03:35 user nova-compute[75354]:     <system>
Nov 14 07:03:35 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:03:35 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:03:35 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:03:35 user nova-compute[75354]:       <entry name="serial">81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f</entry>
Nov 14 07:03:35 user nova-compute[75354]:       <entry name="uuid">81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f</entry>
Nov 14 07:03:35 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:03:35 user nova-compute[75354]:     </system>
Nov 14 07:03:35 user nova-compute[75354]:   </sysinfo>
Nov 14 07:03:35 user nova-compute[75354]:   <os>
Nov 14 07:03:35 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:03:35 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:03:35 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:03:35 user nova-compute[75354]:   </os>
Nov 14 07:03:35 user nova-compute[75354]:   <features>
Nov 14 07:03:35 user nova-compute[75354]:     <acpi/>
Nov 14 07:03:35 user nova-compute[75354]:     <apic/>
Nov 14 07:03:35 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:03:35 user nova-compute[75354]:   </features>
Nov 14 07:03:35 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:03:35 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:03:35 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:03:35 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:03:35 user nova-compute[75354]:   </clock>
Nov 14 07:03:35 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:03:35 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:03:35 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:03:35 user nova-compute[75354]:   </cpu>
Nov 14 07:03:35 user nova-compute[75354]:   <devices>
Nov 14 07:03:35 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:03:35 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:03:35 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk"/>
Nov 14 07:03:35 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:03:35 user nova-compute[75354]:     </disk>
Nov 14 07:03:35 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:03:35 user nova-compute[75354]:       <mac address="fa:16:3e:db:0f:1f"/>
Nov 14 07:03:35 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:03:35 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:03:35 user nova-compute[75354]:       <target dev="tapc54f0951-a2"/>
Nov 14 07:03:35 user nova-compute[75354]:     </interface>
Nov 14 07:03:35 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:03:35 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/console.log" append="off"/>
Nov 14 07:03:35 user nova-compute[75354]:     </serial>
Nov 14 07:03:35 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:03:35 user nova-compute[75354]:     <video>
Nov 14 07:03:35 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:03:35 user nova-compute[75354]:     </video>
Nov 14 07:03:35 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:03:35 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:03:35 user nova-compute[75354]:     </rng>
Nov 14 07:03:35 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:03:35 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:03:35 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:03:35 user nova-compute[75354]:     </memballoon>
Nov 14 07:03:35 user nova-compute[75354]:   </devices>
Nov 14 07:03:35 user nova-compute[75354]: </domain>
Nov 14 07:03:35 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1190076355',display_name='tempest-VolumesNegativeTest-instance-1190076355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1190076355',id=44,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c9d6ede73fc48918f60c2712a728791',ramdisk_id='',reservation_id='r-mlzysydd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1558083114',owner_user_name='tempest-VolumesNegativeTest-1558083114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:03:34Z,user_data=None,user_id='459061efad1d4cab99a44fac0f53fd54',uuid=81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Converting VIF {"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG os_vif [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a71f650-2494-550d-ac4e-328c1196b3a5', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc54f0951-a2, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc54f0951-a2, col_values=(('qos', UUID('934c5cff-a3a3-4642-8adc-f77b832aa204')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc54f0951-a2, col_values=(('external_ids', {'iface-id': 'c54f0951-a2b4-4d56-bb7e-814747b7a338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:0f:1f', 'vm-uuid': '81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:36 user nova-compute[75354]: INFO os_vif [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2')
Nov 14 07:03:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] No VIF found with MAC fa:16:3e:db:0f:1f, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Updated VIF entry in instance network info cache for port c54f0951-a2b4-4d56-bb7e-814747b7a338. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG nova.network.neutron [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Updating instance_info_cache with network_info: [{"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:03:36 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a2740f9a-d1c6-4485-ba9c-9c85330e2f9e req-2a0c6d0e-a889-4545-841a-fb711eaed9af service nova] Releasing lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-7d573cc3-0079-4500-8622-79a36c37beef req-8fe1194c-4f5b-4543-a7e7-d27bf6a2b079 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7d573cc3-0079-4500-8622-79a36c37beef req-8fe1194c-4f5b-4543-a7e7-d27bf6a2b079 service nova] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7d573cc3-0079-4500-8622-79a36c37beef req-8fe1194c-4f5b-4543-a7e7-d27bf6a2b079 service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7d573cc3-0079-4500-8622-79a36c37beef req-8fe1194c-4f5b-4543-a7e7-d27bf6a2b079 service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-7d573cc3-0079-4500-8622-79a36c37beef req-8fe1194c-4f5b-4543-a7e7-d27bf6a2b079 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] No waiting events found dispatching network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:03:37 user nova-compute[75354]: WARNING nova.compute.manager [req-7d573cc3-0079-4500-8622-79a36c37beef req-8fe1194c-4f5b-4543-a7e7-d27bf6a2b079 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received unexpected event network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 for instance with vm_state building and task_state spawning.
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:03:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Instance spawned successfully.
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:03:39 user nova-compute[75354]: INFO nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-7b730fcc-489a-48d6-afe7-47ccf3a2ac15 req-83a14ba6-f0b5-4840-87fc-f8b58873fe92 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7b730fcc-489a-48d6-afe7-47ccf3a2ac15 req-83a14ba6-f0b5-4840-87fc-f8b58873fe92 service nova] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7b730fcc-489a-48d6-afe7-47ccf3a2ac15 req-83a14ba6-f0b5-4840-87fc-f8b58873fe92 service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7b730fcc-489a-48d6-afe7-47ccf3a2ac15 req-83a14ba6-f0b5-4840-87fc-f8b58873fe92 service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:39 user nova-compute[75354]: DEBUG nova.compute.manager [req-7b730fcc-489a-48d6-afe7-47ccf3a2ac15 req-83a14ba6-f0b5-4840-87fc-f8b58873fe92 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] No waiting events found dispatching network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:03:39 user nova-compute[75354]: WARNING nova.compute.manager [req-7b730fcc-489a-48d6-afe7-47ccf3a2ac15 req-83a14ba6-f0b5-4840-87fc-f8b58873fe92 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received unexpected event network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 for instance with vm_state building and task_state spawning.
Nov 14 07:03:39 user nova-compute[75354]: INFO nova.compute.manager [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Took 5.93 seconds to build instance.
Nov 14 07:03:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-e407dffe-9155-414b-b4de-46c8d9d15c1a tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.058s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:03:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:56 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:03:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:03:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:03:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:00 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:01 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:04:01 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.28921127319336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 436cb3cb-d0df-49de-b99c-ead245d9376b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:04:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 436cb3cb-d0df-49de-b99c-ead245d9376b {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [{"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:04:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:04:09 user nova-compute[75354]: INFO nova.compute.claims [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Claim successful on node user
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:04:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.policy [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0158f59d89724d6c8184fa2cf3c5f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc12edce8444919eb156ebd6b2335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:04:09 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Creating image(s)
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "58ec7d6c992881bd5565d711b7d520b827d29abc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "58ec7d6c992881bd5565d711b7d520b827d29abc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Successfully created port: 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG nova.virt.images [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] b15a9f20-4927-4da7-8c65-87b33778cdd6 was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.part /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.part /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.converted" returned: 0 in 0.312s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "58ec7d6c992881bd5565d711b7d520b827d29abc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.083s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Successfully updated port: 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "58ec7d6c992881bd5565d711b7d520b827d29abc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "58ec7d6c992881bd5565d711b7d520b827d29abc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing instance network info cache due to event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc,backing_fmt=raw /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc,backing_fmt=raw /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk 1073741824" returned: 0 in 0.052s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "58ec7d6c992881bd5565d711b7d520b827d29abc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance network_info: |[{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Cannot resize image /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Ensure instance console log exists: /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Start _get_guest_xml network_info=[{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:04:06Z,direct_url=<?>,disk_format='qcow2',id=b15a9f20-4927-4da7-8c65-87b33778cdd6,min_disk=0,min_ram=0,name='tempest-scenario-img--135233627',owner='d7bc12edce8444919eb156ebd6b2335d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:04:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'b15a9f20-4927-4da7-8c65-87b33778cdd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:04:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:04:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:04:06Z,direct_url=<?>,disk_format='qcow2',id=b15a9f20-4927-4da7-8c65-87b33778cdd6,min_disk=0,min_ram=0,name='tempest-scenario-img--135233627',owner='d7bc12edce8444919eb156ebd6b2335d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:04:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1079311238',display_name='tempest-TestMinimumBasicScenario-server-1079311238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1079311238',id=45,image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiCBF1IeT5+H+r8G5TL5uATOIp2a2Y0XTjDRG/s5/NewTmEQuBAtmu0RMYHu+af5YOOzY5jq3ng8xJMLOTFz3lOWSO5Y9LoqcgxH+bBnQ4aQvYZE4tSjRY3OM1xOiMgbw==',key_name='tempest-TestMinimumBasicScenario-1058234875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-d51w0mfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:04:10Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=b0311135-94f2-45e7-b1d5-415813a01f64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'pci_devices' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:04:11 user nova-compute[75354]:   <uuid>b0311135-94f2-45e7-b1d5-415813a01f64</uuid>
Nov 14 07:04:11 user nova-compute[75354]:   <name>instance-0000002d</name>
Nov 14 07:04:11 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:04:11 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:04:11 user nova-compute[75354]:   <metadata>
Nov 14 07:04:11 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:04:11 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:04:11 user nova-compute[75354]:       <nova:name>tempest-TestMinimumBasicScenario-server-1079311238</nova:name>
Nov 14 07:04:11 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:04:11</nova:creationTime>
Nov 14 07:04:11 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:04:11 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:04:11 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:04:11 user nova-compute[75354]:       <nova:owner>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:user uuid="0158f59d89724d6c8184fa2cf3c5f723">tempest-TestMinimumBasicScenario-1130383543-project-member</nova:user>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:project uuid="d7bc12edce8444919eb156ebd6b2335d">tempest-TestMinimumBasicScenario-1130383543</nova:project>
Nov 14 07:04:11 user nova-compute[75354]:       </nova:owner>
Nov 14 07:04:11 user nova-compute[75354]:       <nova:root type="image" uuid="b15a9f20-4927-4da7-8c65-87b33778cdd6"/>
Nov 14 07:04:11 user nova-compute[75354]:       <nova:ports>
Nov 14 07:04:11 user nova-compute[75354]:         <nova:port uuid="839a4b20-eb06-4313-99c5-2e285d9049ef">
Nov 14 07:04:11 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 07:04:11 user nova-compute[75354]:         </nova:port>
Nov 14 07:04:11 user nova-compute[75354]:       </nova:ports>
Nov 14 07:04:11 user nova-compute[75354]:     </nova:instance>
Nov 14 07:04:11 user nova-compute[75354]:   </metadata>
Nov 14 07:04:11 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:04:11 user nova-compute[75354]:     <system>
Nov 14 07:04:11 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:04:11 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:04:11 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:04:11 user nova-compute[75354]:       <entry name="serial">b0311135-94f2-45e7-b1d5-415813a01f64</entry>
Nov 14 07:04:11 user nova-compute[75354]:       <entry name="uuid">b0311135-94f2-45e7-b1d5-415813a01f64</entry>
Nov 14 07:04:11 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:04:11 user nova-compute[75354]:     </system>
Nov 14 07:04:11 user nova-compute[75354]:   </sysinfo>
Nov 14 07:04:11 user nova-compute[75354]:   <os>
Nov 14 07:04:11 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:04:11 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:04:11 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:04:11 user nova-compute[75354]:   </os>
Nov 14 07:04:11 user nova-compute[75354]:   <features>
Nov 14 07:04:11 user nova-compute[75354]:     <acpi/>
Nov 14 07:04:11 user nova-compute[75354]:     <apic/>
Nov 14 07:04:11 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:04:11 user nova-compute[75354]:   </features>
Nov 14 07:04:11 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:04:11 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:04:11 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:04:11 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:04:11 user nova-compute[75354]:   </clock>
Nov 14 07:04:11 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:04:11 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:04:11 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:04:11 user nova-compute[75354]:   </cpu>
Nov 14 07:04:11 user nova-compute[75354]:   <devices>
Nov 14 07:04:11 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:04:11 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:04:11 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk"/>
Nov 14 07:04:11 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:04:11 user nova-compute[75354]:     </disk>
Nov 14 07:04:11 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:04:11 user nova-compute[75354]:       <mac address="fa:16:3e:31:89:20"/>
Nov 14 07:04:11 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:04:11 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:04:11 user nova-compute[75354]:       <target dev="tap839a4b20-eb"/>
Nov 14 07:04:11 user nova-compute[75354]:     </interface>
Nov 14 07:04:11 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:04:11 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/console.log" append="off"/>
Nov 14 07:04:11 user nova-compute[75354]:     </serial>
Nov 14 07:04:11 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:04:11 user nova-compute[75354]:     <video>
Nov 14 07:04:11 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:04:11 user nova-compute[75354]:     </video>
Nov 14 07:04:11 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:04:11 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:04:11 user nova-compute[75354]:     </rng>
Nov 14 07:04:11 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:04:11 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:04:11 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:04:11 user nova-compute[75354]:     </memballoon>
Nov 14 07:04:11 user nova-compute[75354]:   </devices>
Nov 14 07:04:11 user nova-compute[75354]: </domain>
Nov 14 07:04:11 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1079311238',display_name='tempest-TestMinimumBasicScenario-server-1079311238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1079311238',id=45,image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiCBF1IeT5+H+r8G5TL5uATOIp2a2Y0XTjDRG/s5/NewTmEQuBAtmu0RMYHu+af5YOOzY5jq3ng8xJMLOTFz3lOWSO5Y9LoqcgxH+bBnQ4aQvYZE4tSjRY3OM1xOiMgbw==',key_name='tempest-TestMinimumBasicScenario-1058234875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-d51w0mfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:04:10Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=b0311135-94f2-45e7-b1d5-415813a01f64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG os_vif [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '684a21c2-585e-5447-8ddc-1b3c93f4c1ad', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839a4b20-eb, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap839a4b20-eb, col_values=(('qos', UUID('0127f2ed-afb0-40a1-954b-335d46ca93c5')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap839a4b20-eb, col_values=(('external_ids', {'iface-id': '839a4b20-eb06-4313-99c5-2e285d9049ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:89:20', 'vm-uuid': 'b0311135-94f2-45e7-b1d5-415813a01f64'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:11 user nova-compute[75354]: INFO os_vif [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb')
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No VIF found with MAC fa:16:3e:31:89:20, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updated VIF entry in instance network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:04:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a35d46d5-5df0-4c1e-915f-c4080f31d3c2 req-bba2aaca-b763-462a-a9e0-c6dd76f139c9 service nova] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:04:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-e56a7af0-28b7-4719-b149-22892d1c092f req-d7e63457-10d3-4ab4-b35e-3f7f37c5b137 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e56a7af0-28b7-4719-b149-22892d1c092f req-d7e63457-10d3-4ab4-b35e-3f7f37c5b137 service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e56a7af0-28b7-4719-b149-22892d1c092f req-d7e63457-10d3-4ab4-b35e-3f7f37c5b137 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e56a7af0-28b7-4719-b149-22892d1c092f req-d7e63457-10d3-4ab4-b35e-3f7f37c5b137 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-e56a7af0-28b7-4719-b149-22892d1c092f req-d7e63457-10d3-4ab4-b35e-3f7f37c5b137 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:04:13 user nova-compute[75354]: WARNING nova.compute.manager [req-e56a7af0-28b7-4719-b149-22892d1c092f req-d7e63457-10d3-4ab4-b35e-3f7f37c5b137 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state building and task_state spawning.
Nov 14 07:04:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:04:15 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance spawned successfully.
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:04:15 user nova-compute[75354]: INFO nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:04:15 user nova-compute[75354]: INFO nova.compute.manager [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Took 6.04 seconds to build instance.
Nov 14 07:04:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-2a3a927c-69d5-4c9d-afb3-7efd4bf0e225 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.140s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-592a6e87-1974-431d-9e20-0dd27106d5a8 req-96f80339-cc60-4f23-801e-7a47ae3047db service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-592a6e87-1974-431d-9e20-0dd27106d5a8 req-96f80339-cc60-4f23-801e-7a47ae3047db service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-592a6e87-1974-431d-9e20-0dd27106d5a8 req-96f80339-cc60-4f23-801e-7a47ae3047db service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-592a6e87-1974-431d-9e20-0dd27106d5a8 req-96f80339-cc60-4f23-801e-7a47ae3047db service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:04:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-592a6e87-1974-431d-9e20-0dd27106d5a8 req-96f80339-cc60-4f23-801e-7a47ae3047db service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:04:15 user nova-compute[75354]: WARNING nova.compute.manager [req-592a6e87-1974-431d-9e20-0dd27106d5a8 req-96f80339-cc60-4f23-801e-7a47ae3047db service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state active and task_state None.
Nov 14 07:04:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:04:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-changed-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Refreshing instance network info cache due to event network-changed-75717447-03f6-4d7e-9708-77fd0a0cba59. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] Acquiring lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] Acquired lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:04:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Refreshing network info cache for port 75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:04:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updated VIF entry in instance network info cache for port 75717447-03f6-4d7e-9708-77fd0a0cba59. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:04:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [{"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:04:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-b97479e3-f365-4442-b1f0-31728397ba50 req-9e8f5ec1-9508-4dca-865f-2451a7fb8e6a service nova] Releasing lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:04:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:58 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:04:58 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:04:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:02 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:05:02 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=25.18903350830078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 436cb3cb-d0df-49de-b99c-ead245d9376b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b0311135-94f2-45e7-b1d5-415813a01f64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d13f1a9b-9490-4ae8-9ef0-02be20a9dbde has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.155s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:05:02 user nova-compute[75354]: INFO nova.compute.claims [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Claim successful on node user
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:05:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:05:02 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:05:03 user nova-compute[75354]: INFO nova.virt.block_device [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Booting with volume snapshot 9d98155e-6dc7-4058-a363-6c8c22970640 at /dev/vda
Nov 14 07:05:03 user nova-compute[75354]: DEBUG nova.policy [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f9b73f37fb4801aa39ff23e1a095cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9131ea3f6241aead77fcf82f1e8000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:05:03 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Successfully created port: 2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Successfully updated port: 2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquired lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-changed-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Refreshing instance network info cache due to event network-changed-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] Acquiring lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updating instance_info_cache with network_info: [{"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Releasing lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Instance network_info: |[{"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] Acquired lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:05:04 user nova-compute[75354]: DEBUG nova.network.neutron [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Refreshing network info cache for port 2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:05:05 user nova-compute[75354]: DEBUG nova.network.neutron [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updated VIF entry in instance network info cache for port 2e8fd59b-6e13-4ddd-aea9-08126d1b68fb. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:05:05 user nova-compute[75354]: DEBUG nova.network.neutron [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updating instance_info_cache with network_info: [{"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:05:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6fedcb93-ee13-4c78-ac6f-0341df1ca5c3 req-d93e0c12-688a-4d5b-94f1-69c5035df62e service nova] Releasing lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:05:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:05:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:05:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:05:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:05:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Updating instance_info_cache with network_info: [{"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:05:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:05:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:05:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG os_brick.utils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4174e3-8e3c-405e-a366-0c4f6cb5a4ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac3b62-817f-4886-863c-8b3d3dd0792d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c226ab1-a373-421c-a86c-c660e3b56ce6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e11aeaf-bef3-4fa3-8b71-693ce74838d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:05:09 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:05:09 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7ffc75-c110-4c6c-9df2-c905c40ff427]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG os_brick.utils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:05:09 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updating existing volume attachment record: dd1582e8-ba15-4e58-8235-1ddcf25d4553 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:05:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:05:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:05:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:05:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:05:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:05:13 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Creating image(s)
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Ensure instance console log exists: /opt/stack/data/nova/instances/d13f1a9b-9490-4ae8-9ef0-02be20a9dbde/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Start _get_guest_xml network_info=[{"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T07:04:58Z,direct_url=<?>,disk_format='qcow2',id=638b4ce4-2343-4f2e-8b1e-fac45e44bfbb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1551961647',owner='7c9131ea3f6241aead77fcf82f1e8000',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T07:04:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpnNetGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd13f1a9b-9490-4ae8-9ef0-02be20a9dbde', 'attached_at': '', 'detached_at': '', 'volume_id': '80a536cb-0ccc-4d79-858b-5bce0ebac787', 'serial': '80a536cb-0ccc-4d79-858b-5bce0ebac787'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'dd1582e8-ba15-4e58-8235-1ddcf25d4553', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:05:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:05:13 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T07:04:58Z,direct_url=<?>,disk_format='qcow2',id=638b4ce4-2343-4f2e-8b1e-fac45e44bfbb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1551961647',owner='7c9131ea3f6241aead77fcf82f1e8000',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T07:04:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpnNetGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:05:13 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:05:13 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:05:13 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d27b3f-fdee-4fb8-a8c8-2b264b239e81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:05:13 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca15553-8fb8-41d7-afe3-74fc6801f37f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787] added
Nov 14 07:05:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cebc971-27d0-410c-a214-75a3b144cbe7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39ba1a-bbaf-4c30-b425-c377eb6ff042]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpnNetGU {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpnNetGU" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b87732-499e-4925-983c-0db87426c150]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpnNetGU'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f3da94-2c42-4a43-90ed-ab3bfb5107b8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b7db93-1c70-4a83-8d8c-a6e2f4ff9d8e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:05:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:05:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c929333-fd2c-4754-ae0b-198cd6ce5f35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260]
Nov 14 07:05:13 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260] successful.
Nov 14 07:05:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0415e9-25e3-40e4-89a3-a561d734027b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1f4de-4878-44b6-9a29-f7f64b7ac9ff]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:05:13 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:05:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:05:13 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:05:13 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e8c414-e6d0-4757-ad02-8bd82e9e1c3f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:05:13 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpnNetGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23262346531383536', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262346531383536', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-851017062',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-851017062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-851017062',id=46,image_ref='638b4ce4-2343-4f2e-8b1e-fac45e44bfbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEYarupAOl99EBw7vnW7D0J8m2UHeqiwPVgWlLL/x6VU3cuKK9IlWaaa0XKwamXy9AXAIy6yCk5G6jobb7a9Ky8Q5jHJXGtYXK7xCQFDruYLuWhXNA9FGVk/ZWcMYvoMA==',key_name='tempest-keypair-438736748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-6y680rqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1643565198',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:05:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=d13f1a9b-9490-4ae8-9ef0-02be20a9dbde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'pci_devices' on Instance uuid d13f1a9b-9490-4ae8-9ef0-02be20a9dbde {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:05:14 user nova-compute[75354]:   <uuid>d13f1a9b-9490-4ae8-9ef0-02be20a9dbde</uuid>
Nov 14 07:05:14 user nova-compute[75354]:   <name>instance-0000002e</name>
Nov 14 07:05:14 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:05:14 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:05:14 user nova-compute[75354]:   <metadata>
Nov 14 07:05:14 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:05:14 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:05:14 user nova-compute[75354]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-851017062</nova:name>
Nov 14 07:05:14 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:05:13</nova:creationTime>
Nov 14 07:05:14 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:05:14 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:05:14 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:05:14 user nova-compute[75354]:       <nova:owner>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:user uuid="31f9b73f37fb4801aa39ff23e1a095cc">tempest-TestVolumeBootPattern-1643565198-project-member</nova:user>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:project uuid="7c9131ea3f6241aead77fcf82f1e8000">tempest-TestVolumeBootPattern-1643565198</nova:project>
Nov 14 07:05:14 user nova-compute[75354]:       </nova:owner>
Nov 14 07:05:14 user nova-compute[75354]:       <nova:root type="image" uuid="638b4ce4-2343-4f2e-8b1e-fac45e44bfbb"/>
Nov 14 07:05:14 user nova-compute[75354]:       <nova:ports>
Nov 14 07:05:14 user nova-compute[75354]:         <nova:port uuid="2e8fd59b-6e13-4ddd-aea9-08126d1b68fb">
Nov 14 07:05:14 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 07:05:14 user nova-compute[75354]:         </nova:port>
Nov 14 07:05:14 user nova-compute[75354]:       </nova:ports>
Nov 14 07:05:14 user nova-compute[75354]:     </nova:instance>
Nov 14 07:05:14 user nova-compute[75354]:   </metadata>
Nov 14 07:05:14 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:05:14 user nova-compute[75354]:     <system>
Nov 14 07:05:14 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:05:14 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:05:14 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:05:14 user nova-compute[75354]:       <entry name="serial">d13f1a9b-9490-4ae8-9ef0-02be20a9dbde</entry>
Nov 14 07:05:14 user nova-compute[75354]:       <entry name="uuid">d13f1a9b-9490-4ae8-9ef0-02be20a9dbde</entry>
Nov 14 07:05:14 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:05:14 user nova-compute[75354]:     </system>
Nov 14 07:05:14 user nova-compute[75354]:   </sysinfo>
Nov 14 07:05:14 user nova-compute[75354]:   <os>
Nov 14 07:05:14 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:05:14 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:05:14 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:05:14 user nova-compute[75354]:   </os>
Nov 14 07:05:14 user nova-compute[75354]:   <features>
Nov 14 07:05:14 user nova-compute[75354]:     <acpi/>
Nov 14 07:05:14 user nova-compute[75354]:     <apic/>
Nov 14 07:05:14 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:05:14 user nova-compute[75354]:   </features>
Nov 14 07:05:14 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:05:14 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:05:14 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:05:14 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:05:14 user nova-compute[75354]:   </clock>
Nov 14 07:05:14 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:05:14 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:05:14 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:05:14 user nova-compute[75354]:   </cpu>
Nov 14 07:05:14 user nova-compute[75354]:   <devices>
Nov 14 07:05:14 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:05:14 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:05:14 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 07:05:14 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:05:14 user nova-compute[75354]:       <serial>80a536cb-0ccc-4d79-858b-5bce0ebac787</serial>
Nov 14 07:05:14 user nova-compute[75354]:     </disk>
Nov 14 07:05:14 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:05:14 user nova-compute[75354]:       <mac address="fa:16:3e:44:74:b7"/>
Nov 14 07:05:14 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:05:14 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:05:14 user nova-compute[75354]:       <target dev="tap2e8fd59b-6e"/>
Nov 14 07:05:14 user nova-compute[75354]:     </interface>
Nov 14 07:05:14 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:05:14 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/d13f1a9b-9490-4ae8-9ef0-02be20a9dbde/console.log" append="off"/>
Nov 14 07:05:14 user nova-compute[75354]:     </serial>
Nov 14 07:05:14 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:05:14 user nova-compute[75354]:     <video>
Nov 14 07:05:14 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:05:14 user nova-compute[75354]:     </video>
Nov 14 07:05:14 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:05:14 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:05:14 user nova-compute[75354]:     </rng>
Nov 14 07:05:14 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:05:14 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:05:14 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:05:14 user nova-compute[75354]:     </memballoon>
Nov 14 07:05:14 user nova-compute[75354]:   </devices>
Nov 14 07:05:14 user nova-compute[75354]: </domain>
Nov 14 07:05:14 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-851017062',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-851017062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-851017062',id=46,image_ref='638b4ce4-2343-4f2e-8b1e-fac45e44bfbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEYarupAOl99EBw7vnW7D0J8m2UHeqiwPVgWlLL/x6VU3cuKK9IlWaaa0XKwamXy9AXAIy6yCk5G6jobb7a9Ky8Q5jHJXGtYXK7xCQFDruYLuWhXNA9FGVk/ZWcMYvoMA==',key_name='tempest-keypair-438736748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-6y680rqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1643565198',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:05:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=d13f1a9b-9490-4ae8-9ef0-02be20a9dbde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG os_vif [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69dd8b5b-1c1d-5418-adfd-bc006f814067', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e8fd59b-6e, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e8fd59b-6e, col_values=(('qos', UUID('62832bcf-d5b1-4c6b-b66c-d9d16d525185')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e8fd59b-6e, col_values=(('external_ids', {'iface-id': '2e8fd59b-6e13-4ddd-aea9-08126d1b68fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:74:b7', 'vm-uuid': 'd13f1a9b-9490-4ae8-9ef0-02be20a9dbde'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:14 user nova-compute[75354]: INFO os_vif [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e')
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:05:14 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No VIF found with MAC fa:16:3e:44:74:b7, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:05:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-45bb017d-377d-450b-84f5-514791ed401b req-c3c968ea-539a-4a10-976b-308b46020359 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-45bb017d-377d-450b-84f5-514791ed401b req-c3c968ea-539a-4a10-976b-308b46020359 service nova] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-45bb017d-377d-450b-84f5-514791ed401b req-c3c968ea-539a-4a10-976b-308b46020359 service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-45bb017d-377d-450b-84f5-514791ed401b req-c3c968ea-539a-4a10-976b-308b46020359 service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-45bb017d-377d-450b-84f5-514791ed401b req-c3c968ea-539a-4a10-976b-308b46020359 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] No waiting events found dispatching network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:05:16 user nova-compute[75354]: WARNING nova.compute.manager [req-45bb017d-377d-450b-84f5-514791ed401b req-c3c968ea-539a-4a10-976b-308b46020359 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received unexpected event network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb for instance with vm_state building and task_state spawning.
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:05:18 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Instance spawned successfully.
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:05:18 user nova-compute[75354]: INFO nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:05:18 user nova-compute[75354]: INFO nova.compute.manager [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Took 15.72 seconds to build instance.
Nov 14 07:05:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6afba02f-03e3-47ee-b3d8-b4ab2f0133ef tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.827s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-24821a41-2636-4ffc-a6d2-1e5fc72083a0 req-58abe85d-4d74-4c08-a763-a2afe11a0a61 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-24821a41-2636-4ffc-a6d2-1e5fc72083a0 req-58abe85d-4d74-4c08-a763-a2afe11a0a61 service nova] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-24821a41-2636-4ffc-a6d2-1e5fc72083a0 req-58abe85d-4d74-4c08-a763-a2afe11a0a61 service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-24821a41-2636-4ffc-a6d2-1e5fc72083a0 req-58abe85d-4d74-4c08-a763-a2afe11a0a61 service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-24821a41-2636-4ffc-a6d2-1e5fc72083a0 req-58abe85d-4d74-4c08-a763-a2afe11a0a61 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] No waiting events found dispatching network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:05:18 user nova-compute[75354]: WARNING nova.compute.manager [req-24821a41-2636-4ffc-a6d2-1e5fc72083a0 req-58abe85d-4d74-4c08-a763-a2afe11a0a61 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received unexpected event network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb for instance with vm_state active and task_state None.
Nov 14 07:05:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:23 user nova-compute[75354]: INFO nova.compute.manager [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Terminating instance
Nov 14 07:05:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-10f9477c-de69-4dc3-90bd-1a3cc2e66da6 req-c7cd503c-d667-48e2-987e-5654f5b9784c service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-vif-unplugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-10f9477c-de69-4dc3-90bd-1a3cc2e66da6 req-c7cd503c-d667-48e2-987e-5654f5b9784c service nova] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-10f9477c-de69-4dc3-90bd-1a3cc2e66da6 req-c7cd503c-d667-48e2-987e-5654f5b9784c service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-10f9477c-de69-4dc3-90bd-1a3cc2e66da6 req-c7cd503c-d667-48e2-987e-5654f5b9784c service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-10f9477c-de69-4dc3-90bd-1a3cc2e66da6 req-c7cd503c-d667-48e2-987e-5654f5b9784c service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] No waiting events found dispatching network-vif-unplugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.compute.manager [req-10f9477c-de69-4dc3-90bd-1a3cc2e66da6 req-c7cd503c-d667-48e2-987e-5654f5b9784c service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-vif-unplugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Instance destroyed successfully.
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lazy-loading 'resources' on Instance uuid 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1190076355',display_name='tempest-VolumesNegativeTest-instance-1190076355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1190076355',id=44,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c9d6ede73fc48918f60c2712a728791',ramdisk_id='',reservation_id='r-mlzysydd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1558083114',owner_user_name='tempest-VolumesNegativeTest-1558083114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:03:40Z,user_data=None,user_id='459061efad1d4cab99a44fac0f53fd54',uuid=81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Converting VIF {"id": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "address": "fa:16:3e:db:0f:1f", "network": {"id": "bb56093c-1d5e-4835-afa9-625ea7da956f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0604d082fcb34afb9cdff24891cd3fd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54f0951-a2", "ovs_interfaceid": "c54f0951-a2b4-4d56-bb7e-814747b7a338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG os_vif [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc54f0951-a2, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=934c5cff-a3a3-4642-8adc-f77b832aa204) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:05:24 user nova-compute[75354]: INFO os_vif [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:0f:1f,bridge_name='br-int',has_traffic_filtering=True,id=c54f0951-a2b4-4d56-bb7e-814747b7a338,network=Network(bb56093c-1d5e-4835-afa9-625ea7da956f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54f0951-a2')
Nov 14 07:05:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Deleting instance files /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f_del
Nov 14 07:05:24 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Deletion of /opt/stack/data/nova/instances/81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f_del complete
Nov 14 07:05:24 user nova-compute[75354]: INFO nova.compute.manager [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 07:05:24 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:05:24 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:25 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Took 0.50 seconds to deallocate network for instance.
Nov 14 07:05:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-0b78a3ef-73ea-49d0-84c9-6093897ace31 req-e12e0171-53f6-4ef1-8f09-233f3efe2363 service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-vif-deleted-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:05:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:25 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Deleted allocations for instance 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f
Nov 14 07:05:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-cd83fee8-5d22-4615-96a4-679cebc2a661 tempest-VolumesNegativeTest-1558083114 tempest-VolumesNegativeTest-1558083114-project-member] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.623s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Verify base images {{(pid=75354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Image id 638b4ce4-2343-4f2e-8b1e-fac45e44bfbb yields fingerprint fa9f7afcb10066dad247fc403f0e36cfa07ef95e {{(pid=75354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Image id b15a9f20-4927-4da7-8c65-87b33778cdd6 yields fingerprint 58ec7d6c992881bd5565d711b7d520b827d29abc {{(pid=75354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] image b15a9f20-4927-4da7-8c65-87b33778cdd6 at (/opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc): checking
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] image b15a9f20-4927-4da7-8c65-87b33778cdd6 at (/opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc): image is in use {{(pid=75354) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] b0311135-94f2-45e7-b1d5-415813a01f64 is a valid instance name {{(pid=75354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] b0311135-94f2-45e7-b1d5-415813a01f64 has a disk file {{(pid=75354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-366edf37-c7ea-4179-a772-91bc1486c3cd req-9f1af67e-2628-43f7-a0b2-a1ade345b3fb service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received event network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-366edf37-c7ea-4179-a772-91bc1486c3cd req-9f1af67e-2628-43f7-a0b2-a1ade345b3fb service nova] Acquiring lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-366edf37-c7ea-4179-a772-91bc1486c3cd req-9f1af67e-2628-43f7-a0b2-a1ade345b3fb service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-366edf37-c7ea-4179-a772-91bc1486c3cd req-9f1af67e-2628-43f7-a0b2-a1ade345b3fb service nova] Lock "81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.compute.manager [req-366edf37-c7ea-4179-a772-91bc1486c3cd req-9f1af67e-2628-43f7-a0b2-a1ade345b3fb service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] No waiting events found dispatching network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.compute.manager [req-366edf37-c7ea-4179-a772-91bc1486c3cd req-9f1af67e-2628-43f7-a0b2-a1ade345b3fb service nova] [instance: 81792ce6-05ea-4ad6-8e9c-9871cf0eaa9f] Received unexpected event network-vif-plugged-c54f0951-a2b4-4d56-bb7e-814747b7a338 for instance with vm_state deleted and task_state None.
Nov 14 07:05:26 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b0311135-94f2-45e7-b1d5-415813a01f64 is backed by 58ec7d6c992881bd5565d711b7d520b827d29abc {{(pid=75354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] 436cb3cb-d0df-49de-b99c-ead245d9376b is a valid instance name {{(pid=75354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] d13f1a9b-9490-4ae8-9ef0-02be20a9dbde is a valid instance name {{(pid=75354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9
Nov 14 07:05:26 user nova-compute[75354]: WARNING nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Active base files: /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Removable base files: /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509 /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10 /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51 /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9 /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a3d23e64943c65f54f120bf9683521c0b7190509
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bdf884958b488997f4a07b58c6958d103f76e63e
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/def5a8126b49eeda1dcc24b613a9f73a4f1d0b10
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7bda81ff81b8a6ca35945faad2d9947c25b8c75c
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/29f0f8530106e7f27e473d6b6b073f9cac647a51
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7a9ad953c96180d45006a79d80e2f29e783df2d9
Nov 14 07:05:26 user nova-compute[75354]: INFO nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Verification complete {{(pid=75354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Verify swap images {{(pid=75354) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 07:05:26 user nova-compute[75354]: DEBUG nova.virt.libvirt.imagecache [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Verify ephemeral images {{(pid=75354) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 07:05:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:05:59 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:59 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:59 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:05:59 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:05:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG nova.objects.instance [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'flavor' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:01 user nova-compute[75354]: INFO nova.compute.manager [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Attaching volume cb81fd6b-fc12-469d-b0ef-e4f137d22b72 to /dev/vdb
Nov 14 07:06:01 user nova-compute[75354]: DEBUG os_brick.utils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40987fc-2aee-496b-a17c-7a60942a3382]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08e61c-c4d9-4bbe-b7ad-c1440b473339]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7e4c00-9714-4f7f-9966-3e87a48bb38d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3384be72-89f5-468f-99f0-f25399e37794]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:06:01 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:06:01 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4c1a5e-f067-448b-ab8e-7100293a6bd0]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG os_brick.utils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:06:01 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating existing volume attachment record: efea92be-5c8c-4263-b696-9ec640ec4209 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:06:03 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:06:03 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:06:03 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=25.214763641357422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 436cb3cb-d0df-49de-b99c-ead245d9376b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b0311135-94f2-45e7-b1d5-415813a01f64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance d13f1a9b-9490-4ae8-9ef0-02be20a9dbde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:06:06 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:06:06 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:06:06 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[006b5fa4-7941-48b9-a409-f0f2a759aa78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:06:06 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1172c959-c488-4969-afb4-70f7ccf42f75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72] added
Nov 14 07:06:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54f436-29cf-4bad-b204-2458f2949560]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68915f47-9d00-4304-9554-24e67b1baef1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuWGxamZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuWGxamZ" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed2dc4-a82e-4438-976c-fdb31700d558]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuWGxamZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[99763c00-581b-4906-82f2-8b5434f1a626]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c889b4a3-9609-42db-bc31-7cf0a54de802]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f9781-2013-41dc-b0fa-d41143746cb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]
Nov 14 07:06:06 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.
Nov 14 07:06:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1f0931-7352-48dd-b733-5213eefbee01]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a4daf6-144a-4204-beff-be494edc701b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:06 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f7579-2c85-47cd-b0a3-5b765eb590c2]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 436cb3cb-d0df-49de-b99c-ead245d9376b {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [{"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-436cb3cb-d0df-49de-b99c-ead245d9376b" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26630353232323634', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630353232323634', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'flavor' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:06:07 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:06:07 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 07:06:07 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:06:07 user nova-compute[75354]:   <serial>cb81fd6b-fc12-469d-b0ef-e4f137d22b72</serial>
Nov 14 07:06:07 user nova-compute[75354]: </disk>
Nov 14 07:06:07 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No VIF found with MAC fa:16:3e:31:89:20, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:06:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-07209097-cabe-4656-b5e9-83d8e7580c21 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.076s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing instance network info cache due to event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:06:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:06:12 user nova-compute[75354]: DEBUG nova.network.neutron [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updated VIF entry in instance network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:06:12 user nova-compute[75354]: DEBUG nova.network.neutron [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-1cae9e2a-c145-4658-b0b1-428e9deafdb8 req-d9991a4c-207b-4f01-a69e-2fc7de6ddd58 service nova] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing instance network info cache due to event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:06:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:13 user nova-compute[75354]: DEBUG nova.network.neutron [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:06:14 user nova-compute[75354]: DEBUG nova.network.neutron [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updated VIF entry in instance network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:06:14 user nova-compute[75354]: DEBUG nova.network.neutron [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-47dc3729-9fac-45ef-b7f9-1648836780c7 req-de3ec249-6f39-46bb-8519-0718141c7e3d service nova] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:15 user nova-compute[75354]: INFO nova.compute.manager [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Rebooting instance
Nov 14 07:06:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:15 user nova-compute[75354]: DEBUG nova.network.neutron [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-6e28deaf-d724-4f79-82f0-69dffce52dd3 req-d48c7083-e764-4f79-a5a5-6bb48f92fd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-unplugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6e28deaf-d724-4f79-82f0-69dffce52dd3 req-d48c7083-e764-4f79-a5a5-6bb48f92fd58 service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6e28deaf-d724-4f79-82f0-69dffce52dd3 req-d48c7083-e764-4f79-a5a5-6bb48f92fd58 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6e28deaf-d724-4f79-82f0-69dffce52dd3 req-d48c7083-e764-4f79-a5a5-6bb48f92fd58 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.compute.manager [req-6e28deaf-d724-4f79-82f0-69dffce52dd3 req-d48c7083-e764-4f79-a5a5-6bb48f92fd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-unplugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:16 user nova-compute[75354]: WARNING nova.compute.manager [req-6e28deaf-d724-4f79-82f0-69dffce52dd3 req-d48c7083-e764-4f79-a5a5-6bb48f92fd58 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-unplugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state active and task_state reboot_started_hard.
Nov 14 07:06:16 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance destroyed successfully.
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.objects.instance [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'resources' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1079311238',display_name='tempest-TestMinimumBasicScenario-server-1079311238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1079311238',id=45,image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiCBF1IeT5+H+r8G5TL5uATOIp2a2Y0XTjDRG/s5/NewTmEQuBAtmu0RMYHu+af5YOOzY5jq3ng8xJMLOTFz3lOWSO5Y9LoqcgxH+bBnQ4aQvYZE4tSjRY3OM1xOiMgbw==',key_name='tempest-TestMinimumBasicScenario-1058234875',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-d51w0mfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:06:16Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=b0311135-94f2-45e7-b1d5-415813a01f64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG os_vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839a4b20-eb, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0127f2ed-afb0-40a1-954b-335d46ca93c5) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:17 user nova-compute[75354]: INFO os_vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb')
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:06:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90011973-5842-4a17-83f5-daa68abba676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:06:17 user nova-compute[75354]: No targets found.
Nov 14 07:06:17 user nova-compute[75354]: iSNS:
Nov 14 07:06:17 user nova-compute[75354]: No targets found.
Nov 14 07:06:17 user nova-compute[75354]: STATIC:
Nov 14 07:06:17 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72
Nov 14 07:06:17 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:06:17 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:06:17 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787
Nov 14 07:06:17 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:06:17 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:06:17 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089
Nov 14 07:06:17 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:06:17 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:06:17 user nova-compute[75354]: FIRMWARE:
Nov 14 07:06:17 user nova-compute[75354]: No targets found.
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:06:17 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:06:17 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f692b6-3fa3-407d-870a-f20247548198]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9284c8f-fde4-4be6-bd0f-4fcc0ad506d7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074475ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b22df-fed4-4754-b9b1-ac181c653fdf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6d2737-1cd8-4417-8eee-44517e930070]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f93442-8695-4f98-b51a-70ef0279fbe1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ceb42-3b9d-425a-b619-ddce3bb59755]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274117b-3dc7-496e-a257-2b21ea0da47d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0c335-0da6-4025-a21e-1d96cb8b66b6]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]
Nov 14 07:06:17 user nova-compute[75354]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc4853-5c20-4553-82bd-251499649591]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== disconnect_volume: return (310ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Start _get_guest_xml network_info=[{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b15a9f20-4927-4da7-8c65-87b33778cdd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'b15a9f20-4927-4da7-8c65-87b33778cdd6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b0311135-94f2-45e7-b1d5-415813a01f64', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'serial': 'cb81fd6b-fc12-469d-b0ef-e4f137d22b72'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'efea92be-5c8c-4263-b696-9ec640ec4209', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:06:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:06:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b15a9f20-4927-4da7-8c65-87b33778cdd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.objects.instance [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.objects.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Object Instance<b0311135-94f2-45e7-b1d5-415813a01f64> lazy-loaded attributes: resources,vcpu_model {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:06:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:06:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:06:17 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4a9d0-1552-40b8-9ca3-b7a6688db76f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:06:17 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b691ea0-758e-4bdb-818f-297ca7241397]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72] added
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a5550-12cc-4168-bfed-f38e873b858d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d099b27-9d76-4bbb-a94d-28ab2d24f0f1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuWGxamZ {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuWGxamZ" returned: 0 in 0.027s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd1b12-0200-458c-861a-c80ac00c8bee]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuWGxamZ'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ebfcf-23a4-4ebc-8e6e-cd1c2bb12054]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3eed1-9554-4f5f-a6bc-bb9e2485a1c4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d64df2-794d-446b-89f6-1a2f0824dc8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]
Nov 14 07:06:17 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b64abdb-529f-45fd-a98a-acc9412b3a65]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc3165-941e-4f82-bacb-c6633fe1b070]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a21fd-eeb8-44d2-bf51-8539ee1438a8]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:06:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-6931c03b-251c-438f-af0b-5475c5f1ef19 req-958100d8-427f-430b-88b7-8f78731040eb service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6931c03b-251c-438f-af0b-5475c5f1ef19 req-958100d8-427f-430b-88b7-8f78731040eb service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6931c03b-251c-438f-af0b-5475c5f1ef19 req-958100d8-427f-430b-88b7-8f78731040eb service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6931c03b-251c-438f-af0b-5475c5f1ef19 req-958100d8-427f-430b-88b7-8f78731040eb service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-6931c03b-251c-438f-af0b-5475c5f1ef19 req-958100d8-427f-430b-88b7-8f78731040eb service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:18 user nova-compute[75354]: WARNING nova.compute.manager [req-6931c03b-251c-438f-af0b-5475c5f1ef19 req-958100d8-427f-430b-88b7-8f78731040eb service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state active and task_state reboot_started_hard.
Nov 14 07:06:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26630353232323634', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630353232323634', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1079311238',display_name='tempest-TestMinimumBasicScenario-server-1079311238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1079311238',id=45,image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiCBF1IeT5+H+r8G5TL5uATOIp2a2Y0XTjDRG/s5/NewTmEQuBAtmu0RMYHu+af5YOOzY5jq3ng8xJMLOTFz3lOWSO5Y9LoqcgxH+bBnQ4aQvYZE4tSjRY3OM1xOiMgbw==',key_name='tempest-TestMinimumBasicScenario-1058234875',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-d51w0mfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:06:16Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=b0311135-94f2-45e7-b1d5-415813a01f64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.objects.instance [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'pci_devices' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.objects.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Object Instance<b0311135-94f2-45e7-b1d5-415813a01f64> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:06:18 user nova-compute[75354]:   <uuid>b0311135-94f2-45e7-b1d5-415813a01f64</uuid>
Nov 14 07:06:18 user nova-compute[75354]:   <name>instance-0000002d</name>
Nov 14 07:06:18 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:06:18 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:06:18 user nova-compute[75354]:   <metadata>
Nov 14 07:06:18 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:06:18 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:06:18 user nova-compute[75354]:       <nova:name>tempest-TestMinimumBasicScenario-server-1079311238</nova:name>
Nov 14 07:06:18 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:06:17</nova:creationTime>
Nov 14 07:06:18 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:06:18 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:06:18 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:06:18 user nova-compute[75354]:       <nova:owner>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:user uuid="0158f59d89724d6c8184fa2cf3c5f723">tempest-TestMinimumBasicScenario-1130383543-project-member</nova:user>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:project uuid="d7bc12edce8444919eb156ebd6b2335d">tempest-TestMinimumBasicScenario-1130383543</nova:project>
Nov 14 07:06:18 user nova-compute[75354]:       </nova:owner>
Nov 14 07:06:18 user nova-compute[75354]:       <nova:root type="image" uuid="b15a9f20-4927-4da7-8c65-87b33778cdd6"/>
Nov 14 07:06:18 user nova-compute[75354]:       <nova:ports>
Nov 14 07:06:18 user nova-compute[75354]:         <nova:port uuid="839a4b20-eb06-4313-99c5-2e285d9049ef">
Nov 14 07:06:18 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 07:06:18 user nova-compute[75354]:         </nova:port>
Nov 14 07:06:18 user nova-compute[75354]:       </nova:ports>
Nov 14 07:06:18 user nova-compute[75354]:     </nova:instance>
Nov 14 07:06:18 user nova-compute[75354]:   </metadata>
Nov 14 07:06:18 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:06:18 user nova-compute[75354]:     <system>
Nov 14 07:06:18 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:06:18 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:06:18 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:06:18 user nova-compute[75354]:       <entry name="serial">b0311135-94f2-45e7-b1d5-415813a01f64</entry>
Nov 14 07:06:18 user nova-compute[75354]:       <entry name="uuid">b0311135-94f2-45e7-b1d5-415813a01f64</entry>
Nov 14 07:06:18 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:06:18 user nova-compute[75354]:     </system>
Nov 14 07:06:18 user nova-compute[75354]:   </sysinfo>
Nov 14 07:06:18 user nova-compute[75354]:   <os>
Nov 14 07:06:18 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:06:18 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:06:18 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:06:18 user nova-compute[75354]:   </os>
Nov 14 07:06:18 user nova-compute[75354]:   <features>
Nov 14 07:06:18 user nova-compute[75354]:     <acpi/>
Nov 14 07:06:18 user nova-compute[75354]:     <apic/>
Nov 14 07:06:18 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:06:18 user nova-compute[75354]:   </features>
Nov 14 07:06:18 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:06:18 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:06:18 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:06:18 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:06:18 user nova-compute[75354]:   </clock>
Nov 14 07:06:18 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:06:18 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:06:18 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:06:18 user nova-compute[75354]:   </cpu>
Nov 14 07:06:18 user nova-compute[75354]:   <devices>
Nov 14 07:06:18 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:06:18 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:06:18 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk"/>
Nov 14 07:06:18 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:06:18 user nova-compute[75354]:     </disk>
Nov 14 07:06:18 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:06:18 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:06:18 user nova-compute[75354]:       <source dev="/dev/sdd"/>
Nov 14 07:06:18 user nova-compute[75354]:       <target dev="vdb" bus="virtio"/>
Nov 14 07:06:18 user nova-compute[75354]:       <serial>cb81fd6b-fc12-469d-b0ef-e4f137d22b72</serial>
Nov 14 07:06:18 user nova-compute[75354]:     </disk>
Nov 14 07:06:18 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:06:18 user nova-compute[75354]:       <mac address="fa:16:3e:31:89:20"/>
Nov 14 07:06:18 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:06:18 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:06:18 user nova-compute[75354]:       <target dev="tap839a4b20-eb"/>
Nov 14 07:06:18 user nova-compute[75354]:     </interface>
Nov 14 07:06:18 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:06:18 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/console.log" append="off"/>
Nov 14 07:06:18 user nova-compute[75354]:     </serial>
Nov 14 07:06:18 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:06:18 user nova-compute[75354]:     <video>
Nov 14 07:06:18 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:06:18 user nova-compute[75354]:     </video>
Nov 14 07:06:18 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:06:18 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:06:18 user nova-compute[75354]:     </rng>
Nov 14 07:06:18 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:06:18 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:06:18 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:06:18 user nova-compute[75354]:     </memballoon>
Nov 14 07:06:18 user nova-compute[75354]:   </devices>
Nov 14 07:06:18 user nova-compute[75354]: </domain>
Nov 14 07:06:18 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.objects.instance [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.objects.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Object Instance<b0311135-94f2-45e7-b1d5-415813a01f64> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58ec7d6c992881bd5565d711b7d520b827d29abc --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Cannot resize image /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.objects.instance [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'migration_context' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.objects.base [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Object Instance<b0311135-94f2-45e7-b1d5-415813a01f64> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75354) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1079311238',display_name='tempest-TestMinimumBasicScenario-server-1079311238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1079311238',id=45,image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiCBF1IeT5+H+r8G5TL5uATOIp2a2Y0XTjDRG/s5/NewTmEQuBAtmu0RMYHu+af5YOOzY5jq3ng8xJMLOTFz3lOWSO5Y9LoqcgxH+bBnQ4aQvYZE4tSjRY3OM1xOiMgbw==',key_name='tempest-TestMinimumBasicScenario-1058234875',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-d51w0mfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:06:16Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=b0311135-94f2-45e7-b1d5-415813a01f64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG os_vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '684a21c2-585e-5447-8ddc-1b3c93f4c1ad', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839a4b20-eb, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap839a4b20-eb, col_values=(('qos', UUID('fdd26a72-41aa-4e9f-a33f-9c56195e48f0')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap839a4b20-eb, col_values=(('external_ids', {'iface-id': '839a4b20-eb06-4313-99c5-2e285d9049ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:89:20', 'vm-uuid': 'b0311135-94f2-45e7-b1d5-415813a01f64'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:06:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:19 user nova-compute[75354]: INFO os_vif [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb')
Nov 14 07:06:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:20 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-ce54cec6-4e3b-4bfa-a2b8-3e5728187a01 req-197fab02-ba0b-4112-8ac4-68c0cdc83d62 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ce54cec6-4e3b-4bfa-a2b8-3e5728187a01 req-197fab02-ba0b-4112-8ac4-68c0cdc83d62 service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ce54cec6-4e3b-4bfa-a2b8-3e5728187a01 req-197fab02-ba0b-4112-8ac4-68c0cdc83d62 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ce54cec6-4e3b-4bfa-a2b8-3e5728187a01 req-197fab02-ba0b-4112-8ac4-68c0cdc83d62 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG nova.compute.manager [req-ce54cec6-4e3b-4bfa-a2b8-3e5728187a01 req-197fab02-ba0b-4112-8ac4-68c0cdc83d62 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:21 user nova-compute[75354]: WARNING nova.compute.manager [req-ce54cec6-4e3b-4bfa-a2b8-3e5728187a01 req-197fab02-ba0b-4112-8ac4-68c0cdc83d62 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state active and task_state reboot_started_hard.
Nov 14 07:06:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-a718d1a4-fad1-4385-a982-dd217bfe146b req-ce8f5b5a-7796-4e96-9781-093dd53b845e service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a718d1a4-fad1-4385-a982-dd217bfe146b req-ce8f5b5a-7796-4e96-9781-093dd53b845e service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a718d1a4-fad1-4385-a982-dd217bfe146b req-ce8f5b5a-7796-4e96-9781-093dd53b845e service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a718d1a4-fad1-4385-a982-dd217bfe146b req-ce8f5b5a-7796-4e96-9781-093dd53b845e service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG nova.compute.manager [req-a718d1a4-fad1-4385-a982-dd217bfe146b req-ce8f5b5a-7796-4e96-9781-093dd53b845e service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:23 user nova-compute[75354]: WARNING nova.compute.manager [req-a718d1a4-fad1-4385-a982-dd217bfe146b req-ce8f5b5a-7796-4e96-9781-093dd53b845e service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state active and task_state reboot_started_hard.
Nov 14 07:06:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:06:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance rebooted successfully.
Nov 14 07:06:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:06:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-757e8886-d4ce-41e7-818b-1b2a8168d3e9 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.691s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid 436cb3cb-d0df-49de-b99c-ead245d9376b {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Triggering sync for uuid d13f1a9b-9490-4ae8-9ef0-02be20a9dbde {{(pid=75354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:06:45 user nova-compute[75354]: INFO nova.compute.claims [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Claim successful on node user
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:06:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.policy [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1f45b056e334f89bd5dc2f08cf00c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7f91ccf4d439e8506edf2fb082d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:06:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Creating image(s)
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "/opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "/opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:45 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk 1073741824" returned: 0 in 0.051s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Successfully created port: 4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Cannot resize image /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Ensure instance console log exists: /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Successfully updated port: 4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquired lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-changed-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Refreshing instance network info cache due to event network-changed-4371760e-6d4d-4524-8ab8-301c682b286c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] Acquiring lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Releasing lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Instance network_info: |[{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] Acquired lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Refreshing network info cache for port 4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Start _get_guest_xml network_info=[{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:06:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:06:47 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-571207146',display_name='tempest-TestStampPattern-server-571207146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-571207146',id=47,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9t9VYWd1w1dsE+gtMxAxCDrgdh8uSqCFxyqRujjNTBg9BhjvhPHxhc5Hbega0R2r7w1Mh+1Zr1v4G2YbTCuJoHwZxbfPwidU68dZic+8yKh1krNGcE+gx/CEdM8FlqsA==',key_name='tempest-TestStampPattern-916007887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68c7f91ccf4d439e8506edf2fb082d19',ramdisk_id='',reservation_id='r-wwa9es18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1904450519',owner_user_name='tempest-TestStampPattern-1904450519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:06:46Z,user_data=None,user_id='c1f45b056e334f89bd5dc2f08cf00c3c',uuid=ba82e598-3677-4102-b365-2531ac3b3156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converting VIF {"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.objects.instance [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'pci_devices' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:06:47 user nova-compute[75354]:   <uuid>ba82e598-3677-4102-b365-2531ac3b3156</uuid>
Nov 14 07:06:47 user nova-compute[75354]:   <name>instance-0000002f</name>
Nov 14 07:06:47 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:06:47 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:06:47 user nova-compute[75354]:   <metadata>
Nov 14 07:06:47 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:06:47 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:06:47 user nova-compute[75354]:       <nova:name>tempest-TestStampPattern-server-571207146</nova:name>
Nov 14 07:06:47 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:06:47</nova:creationTime>
Nov 14 07:06:47 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:06:47 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:06:47 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:06:47 user nova-compute[75354]:       <nova:owner>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:user uuid="c1f45b056e334f89bd5dc2f08cf00c3c">tempest-TestStampPattern-1904450519-project-member</nova:user>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:project uuid="68c7f91ccf4d439e8506edf2fb082d19">tempest-TestStampPattern-1904450519</nova:project>
Nov 14 07:06:47 user nova-compute[75354]:       </nova:owner>
Nov 14 07:06:47 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 07:06:47 user nova-compute[75354]:       <nova:ports>
Nov 14 07:06:47 user nova-compute[75354]:         <nova:port uuid="4371760e-6d4d-4524-8ab8-301c682b286c">
Nov 14 07:06:47 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 07:06:47 user nova-compute[75354]:         </nova:port>
Nov 14 07:06:47 user nova-compute[75354]:       </nova:ports>
Nov 14 07:06:47 user nova-compute[75354]:     </nova:instance>
Nov 14 07:06:47 user nova-compute[75354]:   </metadata>
Nov 14 07:06:47 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:06:47 user nova-compute[75354]:     <system>
Nov 14 07:06:47 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:06:47 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:06:47 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:06:47 user nova-compute[75354]:       <entry name="serial">ba82e598-3677-4102-b365-2531ac3b3156</entry>
Nov 14 07:06:47 user nova-compute[75354]:       <entry name="uuid">ba82e598-3677-4102-b365-2531ac3b3156</entry>
Nov 14 07:06:47 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:06:47 user nova-compute[75354]:     </system>
Nov 14 07:06:47 user nova-compute[75354]:   </sysinfo>
Nov 14 07:06:47 user nova-compute[75354]:   <os>
Nov 14 07:06:47 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:06:47 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:06:47 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:06:47 user nova-compute[75354]:   </os>
Nov 14 07:06:47 user nova-compute[75354]:   <features>
Nov 14 07:06:47 user nova-compute[75354]:     <acpi/>
Nov 14 07:06:47 user nova-compute[75354]:     <apic/>
Nov 14 07:06:47 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:06:47 user nova-compute[75354]:   </features>
Nov 14 07:06:47 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:06:47 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:06:47 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:06:47 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:06:47 user nova-compute[75354]:   </clock>
Nov 14 07:06:47 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:06:47 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:06:47 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:06:47 user nova-compute[75354]:   </cpu>
Nov 14 07:06:47 user nova-compute[75354]:   <devices>
Nov 14 07:06:47 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:06:47 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:06:47 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk"/>
Nov 14 07:06:47 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:06:47 user nova-compute[75354]:     </disk>
Nov 14 07:06:47 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:06:47 user nova-compute[75354]:       <mac address="fa:16:3e:f4:c8:01"/>
Nov 14 07:06:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:06:47 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:06:47 user nova-compute[75354]:       <target dev="tap4371760e-6d"/>
Nov 14 07:06:47 user nova-compute[75354]:     </interface>
Nov 14 07:06:47 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:06:47 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/console.log" append="off"/>
Nov 14 07:06:47 user nova-compute[75354]:     </serial>
Nov 14 07:06:47 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:06:47 user nova-compute[75354]:     <video>
Nov 14 07:06:47 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:06:47 user nova-compute[75354]:     </video>
Nov 14 07:06:47 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:06:47 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:06:47 user nova-compute[75354]:     </rng>
Nov 14 07:06:47 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:06:47 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:06:47 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:06:47 user nova-compute[75354]:     </memballoon>
Nov 14 07:06:47 user nova-compute[75354]:   </devices>
Nov 14 07:06:47 user nova-compute[75354]: </domain>
Nov 14 07:06:47 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-571207146',display_name='tempest-TestStampPattern-server-571207146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-571207146',id=47,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9t9VYWd1w1dsE+gtMxAxCDrgdh8uSqCFxyqRujjNTBg9BhjvhPHxhc5Hbega0R2r7w1Mh+1Zr1v4G2YbTCuJoHwZxbfPwidU68dZic+8yKh1krNGcE+gx/CEdM8FlqsA==',key_name='tempest-TestStampPattern-916007887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68c7f91ccf4d439e8506edf2fb082d19',ramdisk_id='',reservation_id='r-wwa9es18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1904450519',owner_user_name='tempest-TestStampPattern-1904450519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:06:46Z,user_data=None,user_id='c1f45b056e334f89bd5dc2f08cf00c3c',uuid=ba82e598-3677-4102-b365-2531ac3b3156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converting VIF {"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG os_vif [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08d4f568-336b-5ed0-b420-c8cb3a2c79e8', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4371760e-6d, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4371760e-6d, col_values=(('qos', UUID('5764b00c-b4a9-4d73-bebc-4fc11bc924d2')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4371760e-6d, col_values=(('external_ids', {'iface-id': '4371760e-6d4d-4524-8ab8-301c682b286c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:c8:01', 'vm-uuid': 'ba82e598-3677-4102-b365-2531ac3b3156'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:47 user nova-compute[75354]: INFO os_vif [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d')
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No VIF found with MAC fa:16:3e:f4:c8:01, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updated VIF entry in instance network info cache for port 4371760e-6d4d-4524-8ab8-301c682b286c. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-44cf59a9-0683-47d4-8ad6-c62d549c40bd req-804dfbf3-d647-43cf-a857-d4d15c3e20fe service nova] Releasing lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-4f0bc4a9-529f-4991-9808-743c284f5168 req-d166350d-0b3a-481c-b06c-3c9c39ad078f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4f0bc4a9-529f-4991-9808-743c284f5168 req-d166350d-0b3a-481c-b06c-3c9c39ad078f service nova] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4f0bc4a9-529f-4991-9808-743c284f5168 req-d166350d-0b3a-481c-b06c-3c9c39ad078f service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4f0bc4a9-529f-4991-9808-743c284f5168 req-d166350d-0b3a-481c-b06c-3c9c39ad078f service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG nova.compute.manager [req-4f0bc4a9-529f-4991-9808-743c284f5168 req-d166350d-0b3a-481c-b06c-3c9c39ad078f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] No waiting events found dispatching network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:49 user nova-compute[75354]: WARNING nova.compute.manager [req-4f0bc4a9-529f-4991-9808-743c284f5168 req-d166350d-0b3a-481c-b06c-3c9c39ad078f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received unexpected event network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c for instance with vm_state building and task_state spawning.
Nov 14 07:06:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:06:50 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Instance spawned successfully.
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:06:50 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:06:51 user nova-compute[75354]: INFO nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 14 07:06:51 user nova-compute[75354]: DEBUG nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:06:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-f5b2b1eb-7ffa-4d38-9a24-8cec14ceb0ec req-bc22a9ba-26c4-4851-85ad-0362fe994508 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f5b2b1eb-7ffa-4d38-9a24-8cec14ceb0ec req-bc22a9ba-26c4-4851-85ad-0362fe994508 service nova] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f5b2b1eb-7ffa-4d38-9a24-8cec14ceb0ec req-bc22a9ba-26c4-4851-85ad-0362fe994508 service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f5b2b1eb-7ffa-4d38-9a24-8cec14ceb0ec req-bc22a9ba-26c4-4851-85ad-0362fe994508 service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-f5b2b1eb-7ffa-4d38-9a24-8cec14ceb0ec req-bc22a9ba-26c4-4851-85ad-0362fe994508 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] No waiting events found dispatching network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:51 user nova-compute[75354]: WARNING nova.compute.manager [req-f5b2b1eb-7ffa-4d38-9a24-8cec14ceb0ec req-bc22a9ba-26c4-4851-85ad-0362fe994508 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received unexpected event network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c for instance with vm_state building and task_state spawning.
Nov 14 07:06:51 user nova-compute[75354]: INFO nova.compute.manager [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Took 5.82 seconds to build instance.
Nov 14 07:06:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-6ef9cd44-75f4-43c9-81b0-2b8e20293cd5 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.937s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-changed-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Refreshing instance network info cache due to event network-changed-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] Acquiring lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] Acquired lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Refreshing network info cache for port 2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updated VIF entry in instance network info cache for port 2e8fd59b-6e13-4ddd-aea9-08126d1b68fb. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG nova.network.neutron [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updating instance_info_cache with network_info: [{"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3ba72c9e-35fc-4281-b943-23c887a50301 req-ec125c26-f7de-4894-9bfd-bafa7d9c67f4 service nova] Releasing lock "refresh_cache-d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:53 user nova-compute[75354]: INFO nova.compute.manager [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Terminating instance
Nov 14 07:06:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-93ce196c-5913-4d2b-b833-1dccddcd95f4 req-1c50846b-fb32-47a4-aed9-76fdf6a4ccfd service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-vif-unplugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-93ce196c-5913-4d2b-b833-1dccddcd95f4 req-1c50846b-fb32-47a4-aed9-76fdf6a4ccfd service nova] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-93ce196c-5913-4d2b-b833-1dccddcd95f4 req-1c50846b-fb32-47a4-aed9-76fdf6a4ccfd service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-93ce196c-5913-4d2b-b833-1dccddcd95f4 req-1c50846b-fb32-47a4-aed9-76fdf6a4ccfd service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-93ce196c-5913-4d2b-b833-1dccddcd95f4 req-1c50846b-fb32-47a4-aed9-76fdf6a4ccfd service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] No waiting events found dispatching network-vif-unplugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.compute.manager [req-93ce196c-5913-4d2b-b833-1dccddcd95f4 req-1c50846b-fb32-47a4-aed9-76fdf6a4ccfd service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-vif-unplugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Instance destroyed successfully.
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'resources' on Instance uuid d13f1a9b-9490-4ae8-9ef0-02be20a9dbde {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-851017062',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-851017062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-851017062',id=46,image_ref='638b4ce4-2343-4f2e-8b1e-fac45e44bfbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEYarupAOl99EBw7vnW7D0J8m2UHeqiwPVgWlLL/x6VU3cuKK9IlWaaa0XKwamXy9AXAIy6yCk5G6jobb7a9Ky8Q5jHJXGtYXK7xCQFDruYLuWhXNA9FGVk/ZWcMYvoMA==',key_name='tempest-keypair-438736748',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:05:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-6y680rqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1643565198',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=d13f1a9b-9490-4ae8-9ef0-02be20a9dbde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "address": "fa:16:3e:44:74:b7", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e8fd59b-6e", "ovs_interfaceid": "2e8fd59b-6e13-4ddd-aea9-08126d1b68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_vif [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e8fd59b-6e, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62832bcf-d5b1-4c6b-b66c-d9d16d525185) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:06:54 user nova-compute[75354]: INFO os_vif [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e8fd59b-6e13-4ddd-aea9-08126d1b68fb,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e8fd59b-6e')
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpnNetGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:06:54 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4475768-ff52-4696-91d2-0a333a18d944]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:06:54 user nova-compute[75354]: No targets found.
Nov 14 07:06:54 user nova-compute[75354]: iSNS:
Nov 14 07:06:54 user nova-compute[75354]: No targets found.
Nov 14 07:06:54 user nova-compute[75354]: STATIC:
Nov 14 07:06:54 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72
Nov 14 07:06:54 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:06:54 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:06:54 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787
Nov 14 07:06:54 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:06:54 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:06:54 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089
Nov 14 07:06:54 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:06:54 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:06:54 user nova-compute[75354]: FIRMWARE:
Nov 14 07:06:54 user nova-compute[75354]: No targets found.
Nov 14 07:06:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:06:54 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:06:54 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5316e6-96ef-47ff-8b3a-9515169a41f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c97f9e-10ba-4ffa-a1aa-2c0c83cdfa21]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:54 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:54 user nova-compute[75354]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:06:54 user nova-compute[75354]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 (non-flash)
Nov 14 07:06:54 user nova-compute[75354]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:06:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80942d3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649ca15-b7bf-41e9-a57c-fcdf90b77172]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d188211-edd9-4525-8ae9-01dcfb592d70]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[511bc3a7-7961-4217-af81-2ec39fe9f847]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a77356b-9a53-431a-baed-6b6768659f18]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3dd7d8-bfad-4c5a-bb5b-8148073cd36c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e3ffc-090b-4f76-81bf-578dfef15dc2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260]
Nov 14 07:06:54 user nova-compute[75354]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787, portal: 172.16.0.220,3260] successful.
Nov 14 07:06:54 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a536cb-0ccc-4d79-858b-5bce0ebac787 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbf8fe-b8bd-479d-80d7-51a9e3092ab6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== disconnect_volume: return (316ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:06:54 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Deleting instance files /opt/stack/data/nova/instances/d13f1a9b-9490-4ae8-9ef0-02be20a9dbde_del
Nov 14 07:06:54 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Deletion of /opt/stack/data/nova/instances/d13f1a9b-9490-4ae8-9ef0-02be20a9dbde_del complete
Nov 14 07:06:54 user nova-compute[75354]: INFO nova.compute.manager [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 07:06:54 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:06:54 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:06:55 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:06:55 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Took 0.80 seconds to deallocate network for instance.
Nov 14 07:06:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] Acquiring lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] No waiting events found dispatching network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:06:56 user nova-compute[75354]: WARNING nova.compute.manager [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received unexpected event network-vif-plugged-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb for instance with vm_state active and task_state deleting.
Nov 14 07:06:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-699073be-5820-429d-aa6c-c9de2fadeb88 req-b40068f5-ccf2-44f7-9589-f6841372b0ea service nova] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Received event network-vif-deleted-2e8fd59b-6e13-4ddd-aea9-08126d1b68fb {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:06:56 user nova-compute[75354]: INFO nova.compute.manager [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 07:06:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: d13f1a9b-9490-4ae8-9ef0-02be20a9dbde] Deleting volume: 80a536cb-0ccc-4d79-858b-5bce0ebac787 {{(pid=75354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:06:56 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:06:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:57 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Deleted allocations for instance d13f1a9b-9490-4ae8-9ef0-02be20a9dbde
Nov 14 07:06:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fef5f491-0fc6-4b6b-9a46-e5c3ee844d13 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "d13f1a9b-9490-4ae8-9ef0-02be20a9dbde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.373s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:06:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:06:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:07:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:03 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:07:04 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:07:04 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=25.20932388305664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 436cb3cb-d0df-49de-b99c-ead245d9376b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b0311135-94f2-45e7-b1d5-415813a01f64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:07:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:07:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:07:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:07:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:07:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:07:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:45 user nova-compute[75354]: INFO nova.compute.manager [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Terminating instance
Nov 14 07:07:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-baf662c0-556a-471b-a18e-47fe8f14dfc5 req-b622c6b5-eb52-47f4-b23f-583371286827 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-vif-unplugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-baf662c0-556a-471b-a18e-47fe8f14dfc5 req-b622c6b5-eb52-47f4-b23f-583371286827 service nova] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-baf662c0-556a-471b-a18e-47fe8f14dfc5 req-b622c6b5-eb52-47f4-b23f-583371286827 service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-baf662c0-556a-471b-a18e-47fe8f14dfc5 req-b622c6b5-eb52-47f4-b23f-583371286827 service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-baf662c0-556a-471b-a18e-47fe8f14dfc5 req-b622c6b5-eb52-47f4-b23f-583371286827 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] No waiting events found dispatching network-vif-unplugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-baf662c0-556a-471b-a18e-47fe8f14dfc5 req-b622c6b5-eb52-47f4-b23f-583371286827 service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-vif-unplugged-75717447-03f6-4d7e-9708-77fd0a0cba59 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:07:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Instance destroyed successfully.
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'resources' on Instance uuid 436cb3cb-d0df-49de-b99c-ead245d9376b {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1423913546',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1423913546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1423913546',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeb+S4JzHBDl0/OIKrdA174ZncV4mYJzZ+LbpLp+B5us9RWpZCUwEklR/2bTn1Ueo+EzMUd8JokTfbuvfUfNyz6HUrSm4hW53nvA1ysBWwwS9Puh5iAmfq+Jzn3BJOZvA==',key_name='tempest-keypair-743224293',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-au27is6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=436cb3cb-d0df-49de-b99c-ead245d9376b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "75717447-03f6-4d7e-9708-77fd0a0cba59", "address": "fa:16:3e:4b:b5:71", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75717447-03", "ovs_interfaceid": "75717447-03f6-4d7e-9708-77fd0a0cba59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_vif [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75717447-03, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bbd74a0-a77a-4602-a6df-ad689f37e212) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:46 user nova-compute[75354]: INFO os_vif [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b5:71,bridge_name='br-int',has_traffic_filtering=True,id=75717447-03f6-4d7e-9708-77fd0a0cba59,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75717447-03')
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTuqGeLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:07:46 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[390a010b-eeea-4cea-b944-65c780776638]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:07:46 user nova-compute[75354]: No targets found.
Nov 14 07:07:46 user nova-compute[75354]: iSNS:
Nov 14 07:07:46 user nova-compute[75354]: No targets found.
Nov 14 07:07:46 user nova-compute[75354]: STATIC:
Nov 14 07:07:46 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72
Nov 14 07:07:46 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:07:46 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:07:46 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089
Nov 14 07:07:46 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:07:46 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:07:46 user nova-compute[75354]: FIRMWARE:
Nov 14 07:07:46 user nova-compute[75354]: No targets found.
Nov 14 07:07:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:07:46 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:07:46 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c7ad8-7c4e-4649-8fa4-9f0807a8a120]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea509cbb-4bbb-419c-b6cc-019eca0c34a9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:07:46 user nova-compute[75354]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:07:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 (non-flash)
Nov 14 07:07:46 user nova-compute[75354]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:07:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743df910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c05d5-0f1c-4060-afdf-4040a9f00f9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37cac9f-918d-4af5-a248-b2b9d80a2904]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c88c9-392c-4376-acaa-8aa444abd375]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b158074-c66e-4c5f-bae9-c867e5831726]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a4c3d7b', '/dev/disk/by-id/scsi-23535613233643031', '/dev/disk/by-id/scsi-1SCST_BIO3a4c3d7b-55a23d0161a2ead4') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e0e4d1-7d26-4648-80d1-043d139e138f]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff51f19-034d-4c6d-a32c-cee289caa79b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe5946-b838-444f-a44f-18ce85d25d09]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260]
Nov 14 07:07:46 user nova-compute[75354]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089, portal: 172.16.0.220,3260] successful.
Nov 14 07:07:46 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420b3232-2a66-4089-9bed-5e80f29ef089 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b9c32-392e-4782-b733-411624b0afa4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== disconnect_volume: return (299ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:07:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Deleting instance files /opt/stack/data/nova/instances/436cb3cb-d0df-49de-b99c-ead245d9376b_del
Nov 14 07:07:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Deletion of /opt/stack/data/nova/instances/436cb3cb-d0df-49de-b99c-ead245d9376b_del complete
Nov 14 07:07:46 user nova-compute[75354]: INFO nova.compute.manager [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 07:07:46 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:07:46 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:07:47 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Took 0.90 seconds to deallocate network for instance.
Nov 14 07:07:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-27549ee8-1aed-474c-993a-c68c0c0733bb req-fd7109e2-b59b-4983-a519-93db4266025e service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-vif-deleted-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:07:47 user nova-compute[75354]: INFO nova.compute.manager [req-27549ee8-1aed-474c-993a-c68c0c0733bb req-fd7109e2-b59b-4983-a519-93db4266025e service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Neutron deleted interface 75717447-03f6-4d7e-9708-77fd0a0cba59; detaching it from the instance and deleting it from the info cache
Nov 14 07:07:47 user nova-compute[75354]: DEBUG nova.network.neutron [req-27549ee8-1aed-474c-993a-c68c0c0733bb req-fd7109e2-b59b-4983-a519-93db4266025e service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-27549ee8-1aed-474c-993a-c68c0c0733bb req-fd7109e2-b59b-4983-a519-93db4266025e service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Detach interface failed, port_id=75717447-03f6-4d7e-9708-77fd0a0cba59, reason: Instance 436cb3cb-d0df-49de-b99c-ead245d9376b could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-6875393e-1597-4c90-8023-dde0117d465f req-579bf07c-1979-4513-ab0f-471421eea1fd service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received event network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6875393e-1597-4c90-8023-dde0117d465f req-579bf07c-1979-4513-ab0f-471421eea1fd service nova] Acquiring lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6875393e-1597-4c90-8023-dde0117d465f req-579bf07c-1979-4513-ab0f-471421eea1fd service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6875393e-1597-4c90-8023-dde0117d465f req-579bf07c-1979-4513-ab0f-471421eea1fd service nova] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:47 user nova-compute[75354]: DEBUG nova.compute.manager [req-6875393e-1597-4c90-8023-dde0117d465f req-579bf07c-1979-4513-ab0f-471421eea1fd service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] No waiting events found dispatching network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:07:47 user nova-compute[75354]: WARNING nova.compute.manager [req-6875393e-1597-4c90-8023-dde0117d465f req-579bf07c-1979-4513-ab0f-471421eea1fd service nova] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Received unexpected event network-vif-plugged-75717447-03f6-4d7e-9708-77fd0a0cba59 for instance with vm_state active and task_state deleting.
Nov 14 07:07:48 user nova-compute[75354]: INFO nova.compute.manager [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Took 0.68 seconds to detach 1 volumes for instance.
Nov 14 07:07:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 436cb3cb-d0df-49de-b99c-ead245d9376b] Deleting volume: 420b3232-2a66-4089-9bed-5e80f29ef089 {{(pid=75354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 07:07:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:07:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:07:48 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:07:48 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:07:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:48 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Deleted allocations for instance 436cb3cb-d0df-49de-b99c-ead245d9376b
Nov 14 07:07:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c719261e-42c9-48ce-89b7-dba9281771d9 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "436cb3cb-d0df-49de-b99c-ead245d9376b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.254s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:07:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:07:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:07:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:07:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:07:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:07:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:08:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:02 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:05 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:08:06 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:08:06 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.180652618408203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance b0311135-94f2-45e7-b1d5-415813a01f64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:08:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:08:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing instance network info cache due to event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:08:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:08:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:08:07 user nova-compute[75354]: DEBUG nova.network.neutron [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.network.neutron [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updated VIF entry in instance network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.network.neutron [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-aee557da-1952-4e84-90a9-35fc96412872 req-6476ffb1-2397-4a25-92ed-5b18778a619b service nova] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing instance network info cache due to event network-changed-839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] Acquiring lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] Acquired lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.network.neutron [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Refreshing network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:08 user nova-compute[75354]: INFO nova.compute.manager [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Detaching volume cb81fd6b-fc12-469d-b0ef-e4f137d22b72
Nov 14 07:08:08 user nova-compute[75354]: INFO nova.virt.block_device [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Attempting to driver detach volume cb81fd6b-fc12-469d-b0ef-e4f137d22b72 from mountpoint /dev/vdb
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Attempting to detach device vdb from instance b0311135-94f2-45e7-b1d5-415813a01f64 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:08:08 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:08:08 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 07:08:08 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:08:08 user nova-compute[75354]:   <serial>cb81fd6b-fc12-469d-b0ef-e4f137d22b72</serial>
Nov 14 07:08:08 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 07:08:08 user nova-compute[75354]: </disk>
Nov 14 07:08:08 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:08:08 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully detached device vdb from instance b0311135-94f2-45e7-b1d5-415813a01f64 from the persistent domain config.
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0311135-94f2-45e7-b1d5-415813a01f64 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:08:08 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:08:08 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 07:08:08 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:08:08 user nova-compute[75354]:   <serial>cb81fd6b-fc12-469d-b0ef-e4f137d22b72</serial>
Nov 14 07:08:08 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 07:08:08 user nova-compute[75354]: </disk>
Nov 14 07:08:08 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.network.neutron [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updated VIF entry in instance network info cache for port 839a4b20-eb06-4313-99c5-2e285d9049ef. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG nova.network.neutron [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [{"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:08:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8f585c1-9982-4465-bb90-7e5530e6163f req-3584b42f-58bf-4019-baa0-a71c40a8df06 service nova] Releasing lock "refresh_cache-b0311135-94f2-45e7-b1d5-415813a01f64" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:08:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:08:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:19 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:08:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:29 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b0311135-94f2-45e7-b1d5-415813a01f64 is timed out.
Nov 14 07:08:29 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully detached device vdb from instance b0311135-94f2-45e7-b1d5-415813a01f64 from the live domain config.
Nov 14 07:08:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuWGxamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:08:29 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf88be-81fd-4a43-a755-c0875fdd2a03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:08:29 user nova-compute[75354]: No targets found.
Nov 14 07:08:29 user nova-compute[75354]: iSNS:
Nov 14 07:08:29 user nova-compute[75354]: No targets found.
Nov 14 07:08:29 user nova-compute[75354]: STATIC:
Nov 14 07:08:29 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72
Nov 14 07:08:29 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:08:29 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:08:29 user nova-compute[75354]: FIRMWARE:
Nov 14 07:08:29 user nova-compute[75354]: No targets found.
Nov 14 07:08:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:08:29 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:08:29 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29616ae-70e4-4a46-8875-ecdc8a1841ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b333d023-30b3-4a80-8383-dfadeae0156f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:08:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 (non-flash)
Nov 14 07:08:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741a04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca7b742-a8a3-433c-9049-0e3b363003af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e3be8-7d7d-4880-9db9-c5747d51233e]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3156a-f7d8-4b98-a52c-9c02c4bd13df]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e527e4-a522-4868-84ad-0913bfd43dd3]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fccb5b5-7267-4806-92d2-b64222def05d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601bebe-d123-4624-98ae-dff2d2a6b804]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260]
Nov 14 07:08:29 user nova-compute[75354]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72, portal: 172.16.0.220,3260] successful.
Nov 14 07:08:29 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb81fd6b-fc12-469d-b0ef-e4f137d22b72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a898338-460c-4903-ad93-94670c00280c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== disconnect_volume: return (283ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:08:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:08:30 user nova-compute[75354]: DEBUG nova.objects.instance [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'flavor' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:08:30 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-273f5104-4cee-449d-906f-d06a8bb601c4 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:08:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:08:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:08:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:08:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-changed-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Refreshing instance network info cache due to event network-changed-4371760e-6d4d-4524-8ab8-301c682b286c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] Acquiring lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] Acquired lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Refreshing network info cache for port 4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updated VIF entry in instance network info cache for port 4371760e-6d4d-4524-8ab8-301c682b286c. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:08:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-07b6e8bb-32c2-4bae-8e33-35b260fd3383 req-b95a6a59-edd4-4d2b-b26c-956cb4f79464 service nova] Releasing lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'flavor' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:38 user nova-compute[75354]: INFO nova.compute.manager [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Attaching volume 9e00a1ba-11cf-4803-b3f4-60b8ab79c23b to /dev/vdb
Nov 14 07:08:38 user nova-compute[75354]: DEBUG os_brick.utils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6e5314-817b-421e-aa91-ec5c0c32a44c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14579bc-e398-486f-9422-a3f44c4f7af2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f788ba1-835e-408a-ad22-562c3ba95c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aa2e21-e0b0-4f89-a62f-bb22ef856071]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:08:38 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:08:38 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77d920-cc96-4b4f-a984-e0c41c4f748e]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG os_brick.utils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:08:38 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating existing volume attachment record: 29d78e05-05ca-4e6f-882d-efa74f5b7421 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:08:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVYfncgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:08:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:08:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:08:43 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2402028-b1f8-414d-987f-4bf3c8473180]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:08:43 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b10faa0-56a2-40a9-afa1-625b9bf4001c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b] added
Nov 14 07:08:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[053bc030-f7d7-4b9b-981e-262731bcfc5b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6867bc-69db-42af-be04-d189deba279e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVYfncgp {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVYfncgp" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b3d04-8db4-440a-8fdd-42271e4e130c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVYfncgp'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c49fb67-e1d7-45fe-b8d3-20b22ff91bd7]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:08:43 user nova-compute[75354]: INFO nova.compute.claims [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Claim successful on node user
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54774a-f17d-46e7-a0db-441d3872262f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:08:43 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:08:43 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:08:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:08:43 user nova-compute[75354]: 
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52db5ab-8d4a-435f-b273-03599babd5d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260]
Nov 14 07:08:43 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260] successful.
Nov 14 07:08:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2113d279-7712-4f8c-a30b-7e08bc013600]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f1c4bf-5afd-481f-a493-8cf1fad7c9b3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:08:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:08:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b481baf0-9f71-40bc-b425-19de7b0e2592]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.network.neutron [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:08:43 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.policy [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f9b73f37fb4801aa39ff23e1a095cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9131ea3f6241aead77fcf82f1e8000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:08:43 user nova-compute[75354]: INFO nova.virt.block_device [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Booting with volume e07ee897-3f9d-4193-a9cb-d4f8338dec96 at /dev/vda
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.utils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[135da71d-0caf-400b-978b-506a56e7a1ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18a239-1250-43d6-bb10-cf5167d87268]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55f186-a022-4b2c-b626-db139e995a49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c8722-0761-4061-b37a-48e1e883f1d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:08:43 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:08:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71272771-497c-45c8-bb4a-f4e7a647ec24]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG os_brick.utils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:08:43 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating existing volume attachment record: 28dcf212-ea82-4968-a58a-1918a6efb20b {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Successfully created port: 5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVYfncgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26331383235346531', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331383235346531', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.objects.instance [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'flavor' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:08:44 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:08:44 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:08:44 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:08:44 user nova-compute[75354]:   <serial>9e00a1ba-11cf-4803-b3f4-60b8ab79c23b</serial>
Nov 14 07:08:44 user nova-compute[75354]: </disk>
Nov 14 07:08:44 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No VIF found with MAC fa:16:3e:f4:c8:01, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Successfully updated port: 5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquired lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-changed-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Refreshing instance network info cache due to event network-changed-5cd52309-3ee9-475e-b16b-eaa013ab78f8. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] Acquiring lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG nova.network.neutron [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:08:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f7c156-9dbe-42fd-916f-11e40e51280b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.203s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG nova.network.neutron [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating instance_info_cache with network_info: [{"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Releasing lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Instance network_info: |[{"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] Acquired lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Refreshing network info cache for port 5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updated VIF entry in instance network info cache for port 5cd52309-3ee9-475e-b16b-eaa013ab78f8. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG nova.network.neutron [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating instance_info_cache with network_info: [{"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:08:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-307033a8-9b37-42d0-b5f1-c3a0dc36cbaa req-366a2999-c2f4-4b96-9e70-52b98563b6b0 service nova] Releasing lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:08:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:46 user nova-compute[75354]: INFO nova.compute.manager [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Detaching volume 9e00a1ba-11cf-4803-b3f4-60b8ab79c23b
Nov 14 07:08:47 user nova-compute[75354]: INFO nova.virt.block_device [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Attempting to driver detach volume 9e00a1ba-11cf-4803-b3f4-60b8ab79c23b from mountpoint /dev/vdb
Nov 14 07:08:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Attempting to detach device vdb from instance ba82e598-3677-4102-b365-2531ac3b3156 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:08:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:08:47 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:08:47 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:08:47 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:08:47 user nova-compute[75354]:   <serial>9e00a1ba-11cf-4803-b3f4-60b8ab79c23b</serial>
Nov 14 07:08:47 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:08:47 user nova-compute[75354]: </disk>
Nov 14 07:08:47 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:08:47 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully detached device vdb from instance ba82e598-3677-4102-b365-2531ac3b3156 from the persistent domain config.
Nov 14 07:08:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba82e598-3677-4102-b365-2531ac3b3156 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:08:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:08:47 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:08:47 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:08:47 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:08:47 user nova-compute[75354]:   <serial>9e00a1ba-11cf-4803-b3f4-60b8ab79c23b</serial>
Nov 14 07:08:47 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:08:47 user nova-compute[75354]: </disk>
Nov 14 07:08:47 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:08:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:08:48 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Creating image(s)
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Ensure instance console log exists: /opt/stack/data/nova/instances/79dcf118-6e9d-476f-9c20-288dd3df5ef8/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Start _get_guest_xml network_info=[{"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '79dcf118-6e9d-476f-9c20-288dd3df5ef8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'serial': 'e07ee897-3f9d-4193-a9cb-d4f8338dec96'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '28dcf212-ea82-4968-a58a-1918a6efb20b', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:08:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:08:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:08:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:08:48 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:08:48 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da9fa82-fe62-49df-a0f6-a058f32fbe37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:08:48 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49785e8-b22a-4b10-9ac0-f8b852835822]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96] added
Nov 14 07:08:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac94ade5-7d7f-4470-92c0-b09c963ee772]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[92758fd6-4e70-4dd0-8119-8861f9b1d8ed]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmUlSePH {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmUlSePH" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d86d7-82b3-4312-b375-872e1a3f325d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dmUlSePH'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106bd9b-eb6f-47fe-aeb0-1dd1e241038f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb883fa-89c2-4b5b-8f2f-6c246dd8fb42]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:08:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:08:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804529e-5ab6-49be-b3bb-edfe7b6fbd84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]
Nov 14 07:08:48 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.
Nov 14 07:08:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a11d85-8e99-4047-b7b4-dbba7f7ec8d2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82d977-0a92-4000-8695-11b5dd2cbc94]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:08:48 user nova-compute[75354]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:08:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:08:48 user nova-compute[75354]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:08:48 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7566b7-ef1b-4f94-9b42-bf16d98abf50]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:08:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26337633961643932', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633961643932', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1242386900',display_name='tempest-TestVolumeBootPattern-server-1242386900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1242386900',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-310iqs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:08:44Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=79dcf118-6e9d-476f-9c20-288dd3df5ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.objects.instance [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'pci_devices' on Instance uuid 79dcf118-6e9d-476f-9c20-288dd3df5ef8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:08:49 user nova-compute[75354]:   <uuid>79dcf118-6e9d-476f-9c20-288dd3df5ef8</uuid>
Nov 14 07:08:49 user nova-compute[75354]:   <name>instance-00000030</name>
Nov 14 07:08:49 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:08:49 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:08:49 user nova-compute[75354]:   <metadata>
Nov 14 07:08:49 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:08:49 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:08:49 user nova-compute[75354]:       <nova:name>tempest-TestVolumeBootPattern-server-1242386900</nova:name>
Nov 14 07:08:49 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:08:48</nova:creationTime>
Nov 14 07:08:49 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:08:49 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:08:49 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:08:49 user nova-compute[75354]:       <nova:owner>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:user uuid="31f9b73f37fb4801aa39ff23e1a095cc">tempest-TestVolumeBootPattern-1643565198-project-member</nova:user>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:project uuid="7c9131ea3f6241aead77fcf82f1e8000">tempest-TestVolumeBootPattern-1643565198</nova:project>
Nov 14 07:08:49 user nova-compute[75354]:       </nova:owner>
Nov 14 07:08:49 user nova-compute[75354]:       <nova:ports>
Nov 14 07:08:49 user nova-compute[75354]:         <nova:port uuid="5cd52309-3ee9-475e-b16b-eaa013ab78f8">
Nov 14 07:08:49 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 07:08:49 user nova-compute[75354]:         </nova:port>
Nov 14 07:08:49 user nova-compute[75354]:       </nova:ports>
Nov 14 07:08:49 user nova-compute[75354]:     </nova:instance>
Nov 14 07:08:49 user nova-compute[75354]:   </metadata>
Nov 14 07:08:49 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:08:49 user nova-compute[75354]:     <system>
Nov 14 07:08:49 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:08:49 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:08:49 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:08:49 user nova-compute[75354]:       <entry name="serial">79dcf118-6e9d-476f-9c20-288dd3df5ef8</entry>
Nov 14 07:08:49 user nova-compute[75354]:       <entry name="uuid">79dcf118-6e9d-476f-9c20-288dd3df5ef8</entry>
Nov 14 07:08:49 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:08:49 user nova-compute[75354]:     </system>
Nov 14 07:08:49 user nova-compute[75354]:   </sysinfo>
Nov 14 07:08:49 user nova-compute[75354]:   <os>
Nov 14 07:08:49 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:08:49 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:08:49 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:08:49 user nova-compute[75354]:   </os>
Nov 14 07:08:49 user nova-compute[75354]:   <features>
Nov 14 07:08:49 user nova-compute[75354]:     <acpi/>
Nov 14 07:08:49 user nova-compute[75354]:     <apic/>
Nov 14 07:08:49 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:08:49 user nova-compute[75354]:   </features>
Nov 14 07:08:49 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:08:49 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:08:49 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:08:49 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:08:49 user nova-compute[75354]:   </clock>
Nov 14 07:08:49 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:08:49 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:08:49 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:08:49 user nova-compute[75354]:   </cpu>
Nov 14 07:08:49 user nova-compute[75354]:   <devices>
Nov 14 07:08:49 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:08:49 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:08:49 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 07:08:49 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:08:49 user nova-compute[75354]:       <serial>e07ee897-3f9d-4193-a9cb-d4f8338dec96</serial>
Nov 14 07:08:49 user nova-compute[75354]:     </disk>
Nov 14 07:08:49 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:08:49 user nova-compute[75354]:       <mac address="fa:16:3e:af:33:38"/>
Nov 14 07:08:49 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:08:49 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:08:49 user nova-compute[75354]:       <target dev="tap5cd52309-3e"/>
Nov 14 07:08:49 user nova-compute[75354]:     </interface>
Nov 14 07:08:49 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:08:49 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/79dcf118-6e9d-476f-9c20-288dd3df5ef8/console.log" append="off"/>
Nov 14 07:08:49 user nova-compute[75354]:     </serial>
Nov 14 07:08:49 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:08:49 user nova-compute[75354]:     <video>
Nov 14 07:08:49 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:08:49 user nova-compute[75354]:     </video>
Nov 14 07:08:49 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:08:49 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:08:49 user nova-compute[75354]:     </rng>
Nov 14 07:08:49 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:08:49 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:08:49 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:08:49 user nova-compute[75354]:     </memballoon>
Nov 14 07:08:49 user nova-compute[75354]:   </devices>
Nov 14 07:08:49 user nova-compute[75354]: </domain>
Nov 14 07:08:49 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1242386900',display_name='tempest-TestVolumeBootPattern-server-1242386900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1242386900',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-310iqs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:08:44Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=79dcf118-6e9d-476f-9c20-288dd3df5ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG os_vif [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a0ca848-7fd2-5cb7-bce3-830ef04e7e4c', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cd52309-3e, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cd52309-3e, col_values=(('qos', UUID('648681a0-2a6b-4e14-b505-0da0c66b4635')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cd52309-3e, col_values=(('external_ids', {'iface-id': '5cd52309-3ee9-475e-b16b-eaa013ab78f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:33:38', 'vm-uuid': '79dcf118-6e9d-476f-9c20-288dd3df5ef8'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:49 user nova-compute[75354]: INFO os_vif [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e')
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:08:49 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No VIF found with MAC fa:16:3e:af:33:38, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-c002fdad-aaad-45f3-9191-3e2ef655b2af req-0cdb5080-e17c-4960-98d4-56cde6e7bdfb service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c002fdad-aaad-45f3-9191-3e2ef655b2af req-0cdb5080-e17c-4960-98d4-56cde6e7bdfb service nova] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c002fdad-aaad-45f3-9191-3e2ef655b2af req-0cdb5080-e17c-4960-98d4-56cde6e7bdfb service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c002fdad-aaad-45f3-9191-3e2ef655b2af req-0cdb5080-e17c-4960-98d4-56cde6e7bdfb service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-c002fdad-aaad-45f3-9191-3e2ef655b2af req-0cdb5080-e17c-4960-98d4-56cde6e7bdfb service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] No waiting events found dispatching network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:08:50 user nova-compute[75354]: WARNING nova.compute.manager [req-c002fdad-aaad-45f3-9191-3e2ef655b2af req-0cdb5080-e17c-4960-98d4-56cde6e7bdfb service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received unexpected event network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 for instance with vm_state building and task_state spawning.
Nov 14 07:08:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:08:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Instance spawned successfully.
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:08:52 user nova-compute[75354]: INFO nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Took 4.85 seconds to spawn the instance on the hypervisor.
Nov 14 07:08:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:08:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0dabf62e-0668-4e82-9bf6-557ec25826a2 req-5f49465d-e961-49fb-8b8a-9ce240b271ad service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:08:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0dabf62e-0668-4e82-9bf6-557ec25826a2 req-5f49465d-e961-49fb-8b8a-9ce240b271ad service nova] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:08:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0dabf62e-0668-4e82-9bf6-557ec25826a2 req-5f49465d-e961-49fb-8b8a-9ce240b271ad service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:08:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0dabf62e-0668-4e82-9bf6-557ec25826a2 req-5f49465d-e961-49fb-8b8a-9ce240b271ad service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:53 user nova-compute[75354]: DEBUG nova.compute.manager [req-0dabf62e-0668-4e82-9bf6-557ec25826a2 req-5f49465d-e961-49fb-8b8a-9ce240b271ad service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] No waiting events found dispatching network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:08:53 user nova-compute[75354]: WARNING nova.compute.manager [req-0dabf62e-0668-4e82-9bf6-557ec25826a2 req-5f49465d-e961-49fb-8b8a-9ce240b271ad service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received unexpected event network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 for instance with vm_state active and task_state None.
Nov 14 07:08:53 user nova-compute[75354]: INFO nova.compute.manager [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Took 9.87 seconds to build instance.
Nov 14 07:08:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-81cfa68e-4592-42d1-8e60-1c5fe58b8b9e tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.996s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:08:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:08:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:00 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:01 user nova-compute[75354]: INFO nova.compute.manager [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Terminating instance
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-3633bcc5-4d17-4415-b199-3ce5294a29ed req-5d942887-345d-4690-aeb2-d548a0caac03 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-unplugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3633bcc5-4d17-4415-b199-3ce5294a29ed req-5d942887-345d-4690-aeb2-d548a0caac03 service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3633bcc5-4d17-4415-b199-3ce5294a29ed req-5d942887-345d-4690-aeb2-d548a0caac03 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-3633bcc5-4d17-4415-b199-3ce5294a29ed req-5d942887-345d-4690-aeb2-d548a0caac03 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-3633bcc5-4d17-4415-b199-3ce5294a29ed req-5d942887-345d-4690-aeb2-d548a0caac03 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-unplugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.compute.manager [req-3633bcc5-4d17-4415-b199-3ce5294a29ed req-5d942887-345d-4690-aeb2-d548a0caac03 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-unplugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:09:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Instance destroyed successfully.
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'resources' on Instance uuid b0311135-94f2-45e7-b1d5-415813a01f64 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1079311238',display_name='tempest-TestMinimumBasicScenario-server-1079311238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1079311238',id=45,image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiCBF1IeT5+H+r8G5TL5uATOIp2a2Y0XTjDRG/s5/NewTmEQuBAtmu0RMYHu+af5YOOzY5jq3ng8xJMLOTFz3lOWSO5Y9LoqcgxH+bBnQ4aQvYZE4tSjRY3OM1xOiMgbw==',key_name='tempest-TestMinimumBasicScenario-1058234875',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-d51w0mfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b15a9f20-4927-4da7-8c65-87b33778cdd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:06:23Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=b0311135-94f2-45e7-b1d5-415813a01f64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "839a4b20-eb06-4313-99c5-2e285d9049ef", "address": "fa:16:3e:31:89:20", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839a4b20-eb", "ovs_interfaceid": "839a4b20-eb06-4313-99c5-2e285d9049ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:09:01 user nova-compute[75354]: DEBUG os_vif [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839a4b20-eb, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdd26a72-41aa-4e9f-a33f-9c56195e48f0) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:02 user nova-compute[75354]: INFO os_vif [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:89:20,bridge_name='br-int',has_traffic_filtering=True,id=839a4b20-eb06-4313-99c5-2e285d9049ef,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839a4b20-eb')
Nov 14 07:09:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Deleting instance files /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64_del
Nov 14 07:09:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Deletion of /opt/stack/data/nova/instances/b0311135-94f2-45e7-b1d5-415813a01f64_del complete
Nov 14 07:09:02 user nova-compute[75354]: INFO nova.compute.manager [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 07:09:02 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:09:02 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Took 0.47 seconds to deallocate network for instance.
Nov 14 07:09:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-498c3430-711b-4732-a794-8538fa32e89d req-8df4587c-1a02-4587-b8aa-9474dad13618 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-deleted-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:09:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:02 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Deleted allocations for instance b0311135-94f2-45e7-b1d5-415813a01f64
Nov 14 07:09:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3eab520-d78f-4bf8-aca7-941fe690d916 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "b0311135-94f2-45e7-b1d5-415813a01f64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.656s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-a96dc81d-3e75-4852-b529-4c8f67618dfc req-efe76d94-e25c-41f2-ba31-a7dc6a5e3d57 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a96dc81d-3e75-4852-b529-4c8f67618dfc req-efe76d94-e25c-41f2-ba31-a7dc6a5e3d57 service nova] Acquiring lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a96dc81d-3e75-4852-b529-4c8f67618dfc req-efe76d94-e25c-41f2-ba31-a7dc6a5e3d57 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a96dc81d-3e75-4852-b529-4c8f67618dfc req-efe76d94-e25c-41f2-ba31-a7dc6a5e3d57 service nova] Lock "b0311135-94f2-45e7-b1d5-415813a01f64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:03 user nova-compute[75354]: DEBUG nova.compute.manager [req-a96dc81d-3e75-4852-b529-4c8f67618dfc req-efe76d94-e25c-41f2-ba31-a7dc6a5e3d57 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] No waiting events found dispatching network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:09:03 user nova-compute[75354]: WARNING nova.compute.manager [req-a96dc81d-3e75-4852-b529-4c8f67618dfc req-efe76d94-e25c-41f2-ba31-a7dc6a5e3d57 service nova] [instance: b0311135-94f2-45e7-b1d5-415813a01f64] Received unexpected event network-vif-plugged-839a4b20-eb06-4313-99c5-2e285d9049ef for instance with vm_state deleted and task_state None.
Nov 14 07:09:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:09:07 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba82e598-3677-4102-b365-2531ac3b3156 is timed out.
Nov 14 07:09:07 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully detached device vdb from instance ba82e598-3677-4102-b365-2531ac3b3156 from the live domain config.
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVYfncgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:09:07 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac622c5-f5c3-4103-968d-ed3a0444e6c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:09:07 user nova-compute[75354]: No targets found.
Nov 14 07:09:07 user nova-compute[75354]: iSNS:
Nov 14 07:09:07 user nova-compute[75354]: No targets found.
Nov 14 07:09:07 user nova-compute[75354]: STATIC:
Nov 14 07:09:07 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96
Nov 14 07:09:07 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:09:07 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:09:07 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b
Nov 14 07:09:07 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:09:07 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:09:07 user nova-compute[75354]: FIRMWARE:
Nov 14 07:09:07 user nova-compute[75354]: No targets found.
Nov 14 07:09:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:09:07 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:09:07 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c05c58e-9367-4ceb-9ae1-703119d94f25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a5cf31-f6c0-406f-bff8-8292f0169769]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:09:07 user nova-compute[75354]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:09:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b (non-flash)
Nov 14 07:09:07 user nova-compute[75354]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:09:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743f4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1949284b-ff99-4480-844d-f72bc86a46e5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0258b6-56a6-48b7-8894-0c6864f37ff3]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f61619-d192-4c4e-b169-568f9bac72e5]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4992094-593b-447f-a16c-a76bcb3a2975]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a865352-b3e2-477c-ba96-d9b1fe2e3cd4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cdc67d-8ed8-4b72-ad41-d9aaa00befc3]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260]
Nov 14 07:09:07 user nova-compute[75354]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b, portal: 172.16.0.220,3260] successful.
Nov 14 07:09:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e00a1ba-11cf-4803-b3f4-60b8ab79c23b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa83430-cd1e-4df9-b2fc-e6f0dcf9b980]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] <== disconnect_volume: return (353ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:09:08 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:09:08 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=25.197956085205078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 79dcf118-6e9d-476f-9c20-288dd3df5ef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG nova.objects.instance [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'flavor' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:09:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-efd60f6d-3d5e-4e9d-96f0-b5cf61e3d472 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:09 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:12 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:09:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:39 user nova-compute[75354]: DEBUG nova.compute.manager [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:09:39 user nova-compute[75354]: INFO nova.compute.manager [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] instance snapshotting
Nov 14 07:09:39 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Beginning live snapshot process
Nov 14 07:09:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json -f qcow2 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.171s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx_sodsuv/bb8a131331eb4ec79e2b572290d74d47.delta 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:40 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx_sodsuv/bb8a131331eb4ec79e2b572290d74d47.delta 1073741824" returned: 0 in 0.056s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:40 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 07:09:40 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 07:09:41 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 07:09:41 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 07:09:41 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 07:09:41 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx_sodsuv/bb8a131331eb4ec79e2b572290d74d47.delta /opt/stack/data/nova/instances/snapshots/tmpx_sodsuv/bb8a131331eb4ec79e2b572290d74d47 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:42 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx_sodsuv/bb8a131331eb4ec79e2b572290d74d47.delta /opt/stack/data/nova/instances/snapshots/tmpx_sodsuv/bb8a131331eb4ec79e2b572290d74d47" returned: 0 in 0.658s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:42 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Snapshot extracted, beginning image upload
Nov 14 07:09:44 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Snapshot image upload complete
Nov 14 07:09:44 user nova-compute[75354]: INFO nova.compute.manager [None req-41573562-fe5d-4547-9f0a-405a6aa253c9 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Took 5.10 seconds to snapshot the instance on the hypervisor.
Nov 14 07:09:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:45 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:09:46 user nova-compute[75354]: INFO nova.compute.claims [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Claim successful on node user
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.network.neutron [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:09:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.policy [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1f45b056e334f89bd5dc2f08cf00c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7f91ccf4d439e8506edf2fb082d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:09:46 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Creating image(s)
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "/opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "/opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "/opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "48df49defb68634688a600ddfaaaf5539d35ebe8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "48df49defb68634688a600ddfaaaf5539d35ebe8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG nova.network.neutron [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Successfully created port: 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG nova.virt.images [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] 638b358c-982a-40f0-8295-8606a7df6d19 was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.part /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.part /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.converted" returned: 0 in 0.531s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Successfully updated port: 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-changed-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.compute.manager [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Refreshing instance network info cache due to event network-changed-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] Acquiring lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] Acquired lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Refreshing network info cache for port 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "48df49defb68634688a600ddfaaaf5539d35ebe8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.669s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e04d5b33-150c-4659-ab87-4b57a4912e48 req-9e70b2e9-ec16-4d7f-ae07-0aade555f436 service nova] Releasing lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquired lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "48df49defb68634688a600ddfaaaf5539d35ebe8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "48df49defb68634688a600ddfaaaf5539d35ebe8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8,backing_fmt=raw /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8,backing_fmt=raw /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk 1073741824" returned: 0 in 0.053s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "48df49defb68634688a600ddfaaaf5539d35ebe8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.neutron [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating instance_info_cache with network_info: [{"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Releasing lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Instance network_info: |[{"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48df49defb68634688a600ddfaaaf5539d35ebe8 --force-share --output=json" returned: 0 in 0.193s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Ensure instance console log exists: /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Start _get_guest_xml network_info=[{"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='482e30b3d383bd595f724000bfe7a414',container_format='bare',created_at=2023-11-14T07:09:39Z,direct_url=<?>,disk_format='qcow2',id=638b358c-982a-40f0-8295-8606a7df6d19,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1657260544',owner='68c7f91ccf4d439e8506edf2fb082d19',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T07:09:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '638b358c-982a-40f0-8295-8606a7df6d19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:09:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:09:48 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='482e30b3d383bd595f724000bfe7a414',container_format='bare',created_at=2023-11-14T07:09:39Z,direct_url=<?>,disk_format='qcow2',id=638b358c-982a-40f0-8295-8606a7df6d19,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1657260544',owner='68c7f91ccf4d439e8506edf2fb082d19',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T07:09:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-891390626',display_name='tempest-TestStampPattern-server-891390626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-891390626',id=49,image_ref='638b358c-982a-40f0-8295-8606a7df6d19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9t9VYWd1w1dsE+gtMxAxCDrgdh8uSqCFxyqRujjNTBg9BhjvhPHxhc5Hbega0R2r7w1Mh+1Zr1v4G2YbTCuJoHwZxbfPwidU68dZic+8yKh1krNGcE+gx/CEdM8FlqsA==',key_name='tempest-TestStampPattern-916007887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68c7f91ccf4d439e8506edf2fb082d19',ramdisk_id='',reservation_id='r-lxxk3hn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ba82e598-3677-4102-b365-2531ac3b3156',image_min_disk='1',image_min_ram='0',image_owner_id='68c7f91ccf4d439e8506edf2fb082d19',image_owner_project_name='tempest-TestStampPattern-1904450519',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1904450519-project-member',image_user_id='c1f45b056e334f89bd5dc2f08cf00c3c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1904450519',owner_user_name='tempest-TestStampPattern-1904450519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:09:46Z,user_data=None,user_id='c1f45b056e334f89bd5dc2f08cf00c3c',uuid=e46664cf-afee-42c7-9b08-92f3400ccb53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converting VIF {"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.objects.instance [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'pci_devices' on Instance uuid e46664cf-afee-42c7-9b08-92f3400ccb53 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:09:48 user nova-compute[75354]:   <uuid>e46664cf-afee-42c7-9b08-92f3400ccb53</uuid>
Nov 14 07:09:48 user nova-compute[75354]:   <name>instance-00000031</name>
Nov 14 07:09:48 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:09:48 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:09:48 user nova-compute[75354]:   <metadata>
Nov 14 07:09:48 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:09:48 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:09:48 user nova-compute[75354]:       <nova:name>tempest-TestStampPattern-server-891390626</nova:name>
Nov 14 07:09:48 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:09:48</nova:creationTime>
Nov 14 07:09:48 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:09:48 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:09:48 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:09:48 user nova-compute[75354]:       <nova:owner>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:user uuid="c1f45b056e334f89bd5dc2f08cf00c3c">tempest-TestStampPattern-1904450519-project-member</nova:user>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:project uuid="68c7f91ccf4d439e8506edf2fb082d19">tempest-TestStampPattern-1904450519</nova:project>
Nov 14 07:09:48 user nova-compute[75354]:       </nova:owner>
Nov 14 07:09:48 user nova-compute[75354]:       <nova:root type="image" uuid="638b358c-982a-40f0-8295-8606a7df6d19"/>
Nov 14 07:09:48 user nova-compute[75354]:       <nova:ports>
Nov 14 07:09:48 user nova-compute[75354]:         <nova:port uuid="3e6ae7b4-a793-41a9-93bd-60c38d26c0ab">
Nov 14 07:09:48 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 07:09:48 user nova-compute[75354]:         </nova:port>
Nov 14 07:09:48 user nova-compute[75354]:       </nova:ports>
Nov 14 07:09:48 user nova-compute[75354]:     </nova:instance>
Nov 14 07:09:48 user nova-compute[75354]:   </metadata>
Nov 14 07:09:48 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:09:48 user nova-compute[75354]:     <system>
Nov 14 07:09:48 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:09:48 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:09:48 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:09:48 user nova-compute[75354]:       <entry name="serial">e46664cf-afee-42c7-9b08-92f3400ccb53</entry>
Nov 14 07:09:48 user nova-compute[75354]:       <entry name="uuid">e46664cf-afee-42c7-9b08-92f3400ccb53</entry>
Nov 14 07:09:48 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:09:48 user nova-compute[75354]:     </system>
Nov 14 07:09:48 user nova-compute[75354]:   </sysinfo>
Nov 14 07:09:48 user nova-compute[75354]:   <os>
Nov 14 07:09:48 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:09:48 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:09:48 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:09:48 user nova-compute[75354]:   </os>
Nov 14 07:09:48 user nova-compute[75354]:   <features>
Nov 14 07:09:48 user nova-compute[75354]:     <acpi/>
Nov 14 07:09:48 user nova-compute[75354]:     <apic/>
Nov 14 07:09:48 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:09:48 user nova-compute[75354]:   </features>
Nov 14 07:09:48 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:09:48 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:09:48 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:09:48 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:09:48 user nova-compute[75354]:   </clock>
Nov 14 07:09:48 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:09:48 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:09:48 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:09:48 user nova-compute[75354]:   </cpu>
Nov 14 07:09:48 user nova-compute[75354]:   <devices>
Nov 14 07:09:48 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:09:48 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:09:48 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk"/>
Nov 14 07:09:48 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:09:48 user nova-compute[75354]:     </disk>
Nov 14 07:09:48 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:09:48 user nova-compute[75354]:       <mac address="fa:16:3e:3e:95:1b"/>
Nov 14 07:09:48 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:09:48 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:09:48 user nova-compute[75354]:       <target dev="tap3e6ae7b4-a7"/>
Nov 14 07:09:48 user nova-compute[75354]:     </interface>
Nov 14 07:09:48 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:09:48 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/console.log" append="off"/>
Nov 14 07:09:48 user nova-compute[75354]:     </serial>
Nov 14 07:09:48 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:09:48 user nova-compute[75354]:     <video>
Nov 14 07:09:48 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:09:48 user nova-compute[75354]:     </video>
Nov 14 07:09:48 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:09:48 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:09:48 user nova-compute[75354]:     </rng>
Nov 14 07:09:48 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:09:48 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:09:48 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:09:48 user nova-compute[75354]:     </memballoon>
Nov 14 07:09:48 user nova-compute[75354]:   </devices>
Nov 14 07:09:48 user nova-compute[75354]: </domain>
Nov 14 07:09:48 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-891390626',display_name='tempest-TestStampPattern-server-891390626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-891390626',id=49,image_ref='638b358c-982a-40f0-8295-8606a7df6d19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9t9VYWd1w1dsE+gtMxAxCDrgdh8uSqCFxyqRujjNTBg9BhjvhPHxhc5Hbega0R2r7w1Mh+1Zr1v4G2YbTCuJoHwZxbfPwidU68dZic+8yKh1krNGcE+gx/CEdM8FlqsA==',key_name='tempest-TestStampPattern-916007887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68c7f91ccf4d439e8506edf2fb082d19',ramdisk_id='',reservation_id='r-lxxk3hn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ba82e598-3677-4102-b365-2531ac3b3156',image_min_disk='1',image_min_ram='0',image_owner_id='68c7f91ccf4d439e8506edf2fb082d19',image_owner_project_name='tempest-TestStampPattern-1904450519',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1904450519-project-member',image_user_id='c1f45b056e334f89bd5dc2f08cf00c3c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1904450519',owner_user_name='tempest-TestStampPattern-1904450519-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:09:46Z,user_data=None,user_id='c1f45b056e334f89bd5dc2f08cf00c3c',uuid=e46664cf-afee-42c7-9b08-92f3400ccb53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converting VIF {"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG os_vif [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63983824-7f9a-5637-b6f0-750ad04bf332', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e6ae7b4-a7, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e6ae7b4-a7, col_values=(('qos', UUID('ea6e28a4-44b5-44f3-947f-c2546202490e')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e6ae7b4-a7, col_values=(('external_ids', {'iface-id': '3e6ae7b4-a793-41a9-93bd-60c38d26c0ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:95:1b', 'vm-uuid': 'e46664cf-afee-42c7-9b08-92f3400ccb53'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:48 user nova-compute[75354]: INFO os_vif [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7')
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:09:48 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No VIF found with MAC fa:16:3e:3e:95:1b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-c4372cd6-eeb6-4001-aca0-276cbeb81000 req-2c612b88-6b0b-40b1-98f3-2a9108ead3d7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c4372cd6-eeb6-4001-aca0-276cbeb81000 req-2c612b88-6b0b-40b1-98f3-2a9108ead3d7 service nova] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c4372cd6-eeb6-4001-aca0-276cbeb81000 req-2c612b88-6b0b-40b1-98f3-2a9108ead3d7 service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c4372cd6-eeb6-4001-aca0-276cbeb81000 req-2c612b88-6b0b-40b1-98f3-2a9108ead3d7 service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG nova.compute.manager [req-c4372cd6-eeb6-4001-aca0-276cbeb81000 req-2c612b88-6b0b-40b1-98f3-2a9108ead3d7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] No waiting events found dispatching network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:09:50 user nova-compute[75354]: WARNING nova.compute.manager [req-c4372cd6-eeb6-4001-aca0-276cbeb81000 req-2c612b88-6b0b-40b1-98f3-2a9108ead3d7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received unexpected event network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab for instance with vm_state building and task_state spawning.
Nov 14 07:09:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:09:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Instance spawned successfully.
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:09:52 user nova-compute[75354]: INFO nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-04a4aa26-8a5b-4ff6-99d1-abe6f3cf84ab req-56545aad-c36e-4c79-b31a-6e90e1485f1f service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-04a4aa26-8a5b-4ff6-99d1-abe6f3cf84ab req-56545aad-c36e-4c79-b31a-6e90e1485f1f service nova] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-04a4aa26-8a5b-4ff6-99d1-abe6f3cf84ab req-56545aad-c36e-4c79-b31a-6e90e1485f1f service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-04a4aa26-8a5b-4ff6-99d1-abe6f3cf84ab req-56545aad-c36e-4c79-b31a-6e90e1485f1f service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:52 user nova-compute[75354]: DEBUG nova.compute.manager [req-04a4aa26-8a5b-4ff6-99d1-abe6f3cf84ab req-56545aad-c36e-4c79-b31a-6e90e1485f1f service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] No waiting events found dispatching network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:09:52 user nova-compute[75354]: WARNING nova.compute.manager [req-04a4aa26-8a5b-4ff6-99d1-abe6f3cf84ab req-56545aad-c36e-4c79-b31a-6e90e1485f1f service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received unexpected event network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab for instance with vm_state building and task_state spawning.
Nov 14 07:09:52 user nova-compute[75354]: INFO nova.compute.manager [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Took 6.47 seconds to build instance.
Nov 14 07:09:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4f6311ca-bbb7-4ef4-a757-0af07affb440 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.561s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:09:55 user nova-compute[75354]: INFO nova.compute.claims [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Claim successful on node user
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:09:55 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:09:55 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG nova.policy [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0158f59d89724d6c8184fa2cf3c5f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc12edce8444919eb156ebd6b2335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:09:56 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Creating image(s)
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "/opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "/opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.part --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Successfully created port: ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG nova.virt.images [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] 91ddbb6f-647f-467d-bcb3-b465356ff46e was qcow2, converting to raw {{(pid=75354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG nova.privsep.utils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 07:09:56 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.part /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.converted {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.part /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.converted" returned: 0 in 0.327s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.converted --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.224s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6 --force-share --output=json" returned: 0 in 0.180s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Successfully updated port: ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.compute.manager [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing instance network info cache due to event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6 --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6,backing_fmt=raw /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6,backing_fmt=raw /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk 1073741824" returned: 0 in 0.052s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.network.neutron [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance network_info: |[{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1e4a51bf1985e904f2a7e6a2edf2993b8ca39e6 --force-share --output=json" returned: 0 in 0.191s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:09:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Cannot resize image /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Ensure instance console log exists: /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Start _get_guest_xml network_info=[{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:09:53Z,direct_url=<?>,disk_format='qcow2',id=91ddbb6f-647f-467d-bcb3-b465356ff46e,min_disk=0,min_ram=0,name='tempest-scenario-img--147086739',owner='d7bc12edce8444919eb156ebd6b2335d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:09:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '91ddbb6f-647f-467d-bcb3-b465356ff46e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:09:58 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:09:58 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:09:53Z,direct_url=<?>,disk_format='qcow2',id=91ddbb6f-647f-467d-bcb3-b465356ff46e,min_disk=0,min_ram=0,name='tempest-scenario-img--147086739',owner='d7bc12edce8444919eb156ebd6b2335d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:09:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1209714056',display_name='tempest-TestMinimumBasicScenario-server-1209714056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1209714056',id=50,image_ref='91ddbb6f-647f-467d-bcb3-b465356ff46e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrxz5+Bqfv6nzPc3EsG6U8sODQutLct4rYmZuA3naZ/+ss7wbaJGbkNqmq8dyXvncdXxsJY6Tfgbw1xYy1gahh/CEGcRDXgvMgt4NN0RwKPCa+52XLRFEdULtQt/zhLxw==',key_name='tempest-TestMinimumBasicScenario-1977450361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-guc8tp82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='91ddbb6f-647f-467d-bcb3-b465356ff46e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:09:56Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=fb07d140-7b51-4db2-8acf-a034a38c9d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.objects.instance [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'pci_devices' on Instance uuid fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:09:58 user nova-compute[75354]:   <uuid>fb07d140-7b51-4db2-8acf-a034a38c9d9e</uuid>
Nov 14 07:09:58 user nova-compute[75354]:   <name>instance-00000032</name>
Nov 14 07:09:58 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:09:58 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:09:58 user nova-compute[75354]:   <metadata>
Nov 14 07:09:58 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:09:58 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:09:58 user nova-compute[75354]:       <nova:name>tempest-TestMinimumBasicScenario-server-1209714056</nova:name>
Nov 14 07:09:58 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:09:58</nova:creationTime>
Nov 14 07:09:58 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:09:58 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:09:58 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:09:58 user nova-compute[75354]:       <nova:owner>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:user uuid="0158f59d89724d6c8184fa2cf3c5f723">tempest-TestMinimumBasicScenario-1130383543-project-member</nova:user>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:project uuid="d7bc12edce8444919eb156ebd6b2335d">tempest-TestMinimumBasicScenario-1130383543</nova:project>
Nov 14 07:09:58 user nova-compute[75354]:       </nova:owner>
Nov 14 07:09:58 user nova-compute[75354]:       <nova:root type="image" uuid="91ddbb6f-647f-467d-bcb3-b465356ff46e"/>
Nov 14 07:09:58 user nova-compute[75354]:       <nova:ports>
Nov 14 07:09:58 user nova-compute[75354]:         <nova:port uuid="ae693970-fb3e-4a18-a8f5-245776cd5d9e">
Nov 14 07:09:58 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 07:09:58 user nova-compute[75354]:         </nova:port>
Nov 14 07:09:58 user nova-compute[75354]:       </nova:ports>
Nov 14 07:09:58 user nova-compute[75354]:     </nova:instance>
Nov 14 07:09:58 user nova-compute[75354]:   </metadata>
Nov 14 07:09:58 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:09:58 user nova-compute[75354]:     <system>
Nov 14 07:09:58 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:09:58 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:09:58 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:09:58 user nova-compute[75354]:       <entry name="serial">fb07d140-7b51-4db2-8acf-a034a38c9d9e</entry>
Nov 14 07:09:58 user nova-compute[75354]:       <entry name="uuid">fb07d140-7b51-4db2-8acf-a034a38c9d9e</entry>
Nov 14 07:09:58 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:09:58 user nova-compute[75354]:     </system>
Nov 14 07:09:58 user nova-compute[75354]:   </sysinfo>
Nov 14 07:09:58 user nova-compute[75354]:   <os>
Nov 14 07:09:58 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:09:58 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:09:58 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:09:58 user nova-compute[75354]:   </os>
Nov 14 07:09:58 user nova-compute[75354]:   <features>
Nov 14 07:09:58 user nova-compute[75354]:     <acpi/>
Nov 14 07:09:58 user nova-compute[75354]:     <apic/>
Nov 14 07:09:58 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:09:58 user nova-compute[75354]:   </features>
Nov 14 07:09:58 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:09:58 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:09:58 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:09:58 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:09:58 user nova-compute[75354]:   </clock>
Nov 14 07:09:58 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:09:58 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:09:58 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:09:58 user nova-compute[75354]:   </cpu>
Nov 14 07:09:58 user nova-compute[75354]:   <devices>
Nov 14 07:09:58 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:09:58 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:09:58 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk"/>
Nov 14 07:09:58 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:09:58 user nova-compute[75354]:     </disk>
Nov 14 07:09:58 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:09:58 user nova-compute[75354]:       <mac address="fa:16:3e:cb:ac:0b"/>
Nov 14 07:09:58 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:09:58 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:09:58 user nova-compute[75354]:       <target dev="tapae693970-fb"/>
Nov 14 07:09:58 user nova-compute[75354]:     </interface>
Nov 14 07:09:58 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:09:58 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/console.log" append="off"/>
Nov 14 07:09:58 user nova-compute[75354]:     </serial>
Nov 14 07:09:58 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:09:58 user nova-compute[75354]:     <video>
Nov 14 07:09:58 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:09:58 user nova-compute[75354]:     </video>
Nov 14 07:09:58 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:09:58 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:09:58 user nova-compute[75354]:     </rng>
Nov 14 07:09:58 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:09:58 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:09:58 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:09:58 user nova-compute[75354]:     </memballoon>
Nov 14 07:09:58 user nova-compute[75354]:   </devices>
Nov 14 07:09:58 user nova-compute[75354]: </domain>
Nov 14 07:09:58 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1209714056',display_name='tempest-TestMinimumBasicScenario-server-1209714056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1209714056',id=50,image_ref='91ddbb6f-647f-467d-bcb3-b465356ff46e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrxz5+Bqfv6nzPc3EsG6U8sODQutLct4rYmZuA3naZ/+ss7wbaJGbkNqmq8dyXvncdXxsJY6Tfgbw1xYy1gahh/CEGcRDXgvMgt4NN0RwKPCa+52XLRFEdULtQt/zhLxw==',key_name='tempest-TestMinimumBasicScenario-1977450361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-guc8tp82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='91ddbb6f-647f-467d-bcb3-b465356ff46e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:09:56Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=fb07d140-7b51-4db2-8acf-a034a38c9d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG os_vif [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b8ac522-f9cb-5f23-b687-d9d015c45c03', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae693970-fb, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae693970-fb, col_values=(('qos', UUID('d6870755-f1b1-4c79-abca-e1fa07208eff')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae693970-fb, col_values=(('external_ids', {'iface-id': 'ae693970-fb3e-4a18-a8f5-245776cd5d9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ac:0b', 'vm-uuid': 'fb07d140-7b51-4db2-8acf-a034a38c9d9e'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:58 user nova-compute[75354]: INFO os_vif [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb')
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No VIF found with MAC fa:16:3e:cb:ac:0b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.network.neutron [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated VIF entry in instance network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG nova.network.neutron [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:09:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-2fb63bb9-4136-4ff6-aec7-d25f1d535c4c req-6a022bf9-7e86-4aba-816a-45f65843589e service nova] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-9cfdae55-19f8-40bd-88e3-f91dd8d0569a req-b668b120-6b7d-45e6-861d-ba7acf08499f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9cfdae55-19f8-40bd-88e3-f91dd8d0569a req-b668b120-6b7d-45e6-861d-ba7acf08499f service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9cfdae55-19f8-40bd-88e3-f91dd8d0569a req-b668b120-6b7d-45e6-861d-ba7acf08499f service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-9cfdae55-19f8-40bd-88e3-f91dd8d0569a req-b668b120-6b7d-45e6-861d-ba7acf08499f service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:09:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-9cfdae55-19f8-40bd-88e3-f91dd8d0569a req-b668b120-6b7d-45e6-861d-ba7acf08499f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:09:59 user nova-compute[75354]: WARNING nova.compute.manager [req-9cfdae55-19f8-40bd-88e3-f91dd8d0569a req-b668b120-6b7d-45e6-861d-ba7acf08499f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state building and task_state spawning.
Nov 14 07:10:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:10:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance spawned successfully.
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:10:01 user nova-compute[75354]: INFO nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 14 07:10:01 user nova-compute[75354]: DEBUG nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:10:01 user nova-compute[75354]: INFO nova.compute.manager [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Took 6.31 seconds to build instance.
Nov 14 07:10:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-fda3de02-9b66-4587-aa39-de3a484c03c0 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.404s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-0dd2f4cc-a553-4ca5-ad67-055d375c34bf req-e73b7434-4665-4a99-9d4f-8f6c75496c38 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:10:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0dd2f4cc-a553-4ca5-ad67-055d375c34bf req-e73b7434-4665-4a99-9d4f-8f6c75496c38 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0dd2f4cc-a553-4ca5-ad67-055d375c34bf req-e73b7434-4665-4a99-9d4f-8f6c75496c38 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0dd2f4cc-a553-4ca5-ad67-055d375c34bf req-e73b7434-4665-4a99-9d4f-8f6c75496c38 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-0dd2f4cc-a553-4ca5-ad67-055d375c34bf req-e73b7434-4665-4a99-9d4f-8f6c75496c38 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:10:02 user nova-compute[75354]: WARNING nova.compute.manager [req-0dd2f4cc-a553-4ca5-ad67-055d375c34bf req-e73b7434-4665-4a99-9d4f-8f6c75496c38 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state active and task_state None.
Nov 14 07:10:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:04 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:10:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:10:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=25.03002166748047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 79dcf118-6e9d-476f-9c20-288dd3df5ef8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance e46664cf-afee-42c7-9b08-92f3400ccb53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance fb07d140-7b51-4db2-8acf-a034a38c9d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:10:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:10 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating instance_info_cache with network_info: [{"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:10:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:22 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:10:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-changed-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:10:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Refreshing instance network info cache due to event network-changed-5cd52309-3ee9-475e-b16b-eaa013ab78f8. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:10:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] Acquiring lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:10:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] Acquired lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:10:34 user nova-compute[75354]: DEBUG nova.network.neutron [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Refreshing network info cache for port 5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updated VIF entry in instance network info cache for port 5cd52309-3ee9-475e-b16b-eaa013ab78f8. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG nova.network.neutron [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating instance_info_cache with network_info: [{"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6c2dc12a-57f3-4c0a-8153-9c45c0dd1f01 req-46b6d9c4-060a-4f4f-954f-a673060c4268 service nova] Releasing lock "refresh_cache-79dcf118-6e9d-476f-9c20-288dd3df5ef8" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:35 user nova-compute[75354]: INFO nova.compute.manager [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Terminating instance
Nov 14 07:10:35 user nova-compute[75354]: DEBUG nova.compute.manager [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-12099f4f-1c88-4a87-926b-17c15ca44308 req-f85a6768-985a-4d76-b3b1-74de1ecd76e5 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-vif-unplugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-12099f4f-1c88-4a87-926b-17c15ca44308 req-f85a6768-985a-4d76-b3b1-74de1ecd76e5 service nova] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-12099f4f-1c88-4a87-926b-17c15ca44308 req-f85a6768-985a-4d76-b3b1-74de1ecd76e5 service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-12099f4f-1c88-4a87-926b-17c15ca44308 req-f85a6768-985a-4d76-b3b1-74de1ecd76e5 service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-12099f4f-1c88-4a87-926b-17c15ca44308 req-f85a6768-985a-4d76-b3b1-74de1ecd76e5 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] No waiting events found dispatching network-vif-unplugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:10:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-12099f4f-1c88-4a87-926b-17c15ca44308 req-f85a6768-985a-4d76-b3b1-74de1ecd76e5 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-vif-unplugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:10:36 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Instance destroyed successfully.
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.objects.instance [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'resources' on Instance uuid 79dcf118-6e9d-476f-9c20-288dd3df5ef8 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1242386900',display_name='tempest-TestVolumeBootPattern-server-1242386900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1242386900',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:08:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-310iqs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:08:53Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=79dcf118-6e9d-476f-9c20-288dd3df5ef8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "address": "fa:16:3e:af:33:38", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd52309-3e", "ovs_interfaceid": "5cd52309-3ee9-475e-b16b-eaa013ab78f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_vif [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cd52309-3e, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=648681a0-2a6b-4e14-b505-0da0c66b4635) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:36 user nova-compute[75354]: INFO os_vif [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:33:38,bridge_name='br-int',has_traffic_filtering=True,id=5cd52309-3ee9-475e-b16b-eaa013ab78f8,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd52309-3e')
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:10:36 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc4ad5-9cb1-4450-a50c-48db0f58e12c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:10:36 user nova-compute[75354]: No targets found.
Nov 14 07:10:36 user nova-compute[75354]: iSNS:
Nov 14 07:10:36 user nova-compute[75354]: No targets found.
Nov 14 07:10:36 user nova-compute[75354]: STATIC:
Nov 14 07:10:36 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96
Nov 14 07:10:36 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:10:36 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:10:36 user nova-compute[75354]: FIRMWARE:
Nov 14 07:10:36 user nova-compute[75354]: No targets found.
Nov 14 07:10:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:10:36 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:10:36 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4cfe74-df95-4622-928d-45bbd2d91dc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca1eacc-99da-4cfd-837c-a76cd37a5d26]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:10:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:10:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80742f63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1286285f-a03a-4ab4-a5a0-d688aa193cf7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b62a9ee-a5f5-49f8-96dd-585527bc2124]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[07834a52-28a4-4cf8-aff7-e91cdd4b8385]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a867be3-8d0f-4cb4-a7eb-d39715f01432]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO16540fd2-c7c9ad9260f8462a', '/dev/disk/by-id/scsi-26337633961643932', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_16540fd2') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a9fef3-e3e8-4ca4-abcf-6a9e44fd52ea]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e7f3bb-20f1-4c31-957c-4c37431d012a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b583d05-8498-4ae5-9c8a-8e61f1401900]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]
Nov 14 07:10:36 user nova-compute[75354]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.
Nov 14 07:10:36 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2cdcbd-1eb7-477b-84bb-d00621107d9c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== disconnect_volume: return (296ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:10:36 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Deleting instance files /opt/stack/data/nova/instances/79dcf118-6e9d-476f-9c20-288dd3df5ef8_del
Nov 14 07:10:36 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Deletion of /opt/stack/data/nova/instances/79dcf118-6e9d-476f-9c20-288dd3df5ef8_del complete
Nov 14 07:10:36 user nova-compute[75354]: INFO nova.compute.manager [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 07:10:36 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:10:36 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-fd175335-3ee1-4200-8d48-8eb334171fca req-d6ce4311-1cc1-4233-8bbe-5b61269f6de0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-vif-deleted-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:10:37 user nova-compute[75354]: INFO nova.compute.manager [req-fd175335-3ee1-4200-8d48-8eb334171fca req-d6ce4311-1cc1-4233-8bbe-5b61269f6de0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Neutron deleted interface 5cd52309-3ee9-475e-b16b-eaa013ab78f8; detaching it from the instance and deleting it from the info cache
Nov 14 07:10:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-fd175335-3ee1-4200-8d48-8eb334171fca req-d6ce4311-1cc1-4233-8bbe-5b61269f6de0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:10:37 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Took 0.71 seconds to deallocate network for instance.
Nov 14 07:10:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-fd175335-3ee1-4200-8d48-8eb334171fca req-d6ce4311-1cc1-4233-8bbe-5b61269f6de0 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Detach interface failed, port_id=5cd52309-3ee9-475e-b16b-eaa013ab78f8, reason: Instance 79dcf118-6e9d-476f-9c20-288dd3df5ef8 could not be found. {{(pid=75354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-0b465c1e-6c4b-443f-b177-05524c2d6e52 req-4bc4b747-41a8-4d3b-baa0-382bb44fbb48 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received event network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0b465c1e-6c4b-443f-b177-05524c2d6e52 req-4bc4b747-41a8-4d3b-baa0-382bb44fbb48 service nova] Acquiring lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0b465c1e-6c4b-443f-b177-05524c2d6e52 req-4bc4b747-41a8-4d3b-baa0-382bb44fbb48 service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0b465c1e-6c4b-443f-b177-05524c2d6e52 req-4bc4b747-41a8-4d3b-baa0-382bb44fbb48 service nova] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-0b465c1e-6c4b-443f-b177-05524c2d6e52 req-4bc4b747-41a8-4d3b-baa0-382bb44fbb48 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] No waiting events found dispatching network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:10:37 user nova-compute[75354]: WARNING nova.compute.manager [req-0b465c1e-6c4b-443f-b177-05524c2d6e52 req-4bc4b747-41a8-4d3b-baa0-382bb44fbb48 service nova] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Received unexpected event network-vif-plugged-5cd52309-3ee9-475e-b16b-eaa013ab78f8 for instance with vm_state active and task_state deleting.
Nov 14 07:10:38 user nova-compute[75354]: INFO nova.compute.manager [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 79dcf118-6e9d-476f-9c20-288dd3df5ef8] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 07:10:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:10:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:10:38 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:10:38 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:10:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:38 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Deleted allocations for instance 79dcf118-6e9d-476f-9c20-288dd3df5ef8
Nov 14 07:10:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-7054fd62-e31e-409d-925e-ac40455b447d tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "79dcf118-6e9d-476f-9c20-288dd3df5ef8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.253s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:10:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:10:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:10:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:10:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:10:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:10:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:10:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:10:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:03 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:04 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:11:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:11:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.000843048095703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance e46664cf-afee-42c7-9b08-92f3400ccb53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance fb07d140-7b51-4db2-8acf-a034a38c9d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:11:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:11:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:11:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:11:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "da332860-2962-4c03-9c6c-416949017220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "da332860-2962-4c03-9c6c-416949017220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:11:27 user nova-compute[75354]: INFO nova.compute.claims [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Claim successful on node user
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.network.neutron [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:11:27 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.policy [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f9b73f37fb4801aa39ff23e1a095cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9131ea3f6241aead77fcf82f1e8000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:11:27 user nova-compute[75354]: INFO nova.virt.block_device [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Booting with volume e07ee897-3f9d-4193-a9cb-d4f8338dec96 at /dev/vda
Nov 14 07:11:27 user nova-compute[75354]: DEBUG os_brick.utils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[538d44d0-bf6d-4ed8-8743-5fa7b57d1fba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cfa7ec-d02e-4e65-8f40-6bca6ef91339]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad331841-7b0f-4710-9163-ba4c30747786]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f880c-8f97-4140-9b2a-f23ac93b3dae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:11:27 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:11:27 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a9e578-f041-48c3-9520-7e1ecd91f0f3]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG os_brick.utils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:11:27 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Updating existing volume attachment record: 5057e611-19ef-4eed-8c5d-068b9443f3a0 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Successfully created port: f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Successfully updated port: f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquired lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-changed-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG nova.compute.manager [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Refreshing instance network info cache due to event network-changed-f5bd5c51-6645-4df0-9446-044dc73e6afe. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] Acquiring lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:28 user nova-compute[75354]: DEBUG nova.network.neutron [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG nova.network.neutron [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Updating instance_info_cache with network_info: [{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Releasing lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Instance network_info: |[{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] Acquired lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG nova.network.neutron [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Refreshing network info cache for port f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG nova.network.neutron [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Updated VIF entry in instance network info cache for port f5bd5c51-6645-4df0-9446-044dc73e6afe. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG nova.network.neutron [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Updating instance_info_cache with network_info: [{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:11:29 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a0a0acb0-b1fb-4299-8d5f-2440396b1f6f req-865f54d4-8644-4d84-8318-deb89cdf1992 service nova] Releasing lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:11:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:11:32 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Creating image(s)
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Ensure instance console log exists: /opt/stack/data/nova/instances/da332860-2962-4c03-9c6c-416949017220/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Start _get_guest_xml network_info=[{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da332860-2962-4c03-9c6c-416949017220', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'serial': 'e07ee897-3f9d-4193-a9cb-d4f8338dec96'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '5057e611-19ef-4eed-8c5d-068b9443f3a0', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:11:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:11:32 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:11:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:11:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:11:32 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3a2d86-e181-4f51-a863-0e4f5a14fcd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:11:32 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b3725e-31a9-42d9-b6a1-ba0c3bc92d00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96] added
Nov 14 07:11:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.158s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca4c2b-fa35-4060-9da8-dbcdcaf55dfa]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa6624-c5b5-4ef8-bab3-0b96236f90d0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmUlSePH {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmUlSePH" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e643a1-6b8f-44b9-8b6b-8744b78eeacd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dmUlSePH'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[469b0991-d9e9-4a29-b1eb-43c300b5005f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc49c17f-a428-4b1b-ab8b-9aac24b6e29e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:11:32 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:11:32 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:11:32 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:11:32 user nova-compute[75354]: 
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afc2fef-2f8e-4bee-a578-7d46111de560]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]
Nov 14 07:11:32 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.
Nov 14 07:11:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a309a5-c3bf-4ebf-89e7-ea3fe6755f32]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53227a3f-5ca2-4bcd-8efc-01330e10552a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:32 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9254de-03e6-4eff-8f44-0d3e35fda955]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:32 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '26337633961643932', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633961643932', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-208674996',display_name='tempest-TestVolumeBootPattern-server-208674996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-208674996',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-po4xweqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:11:28Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=da332860-2962-4c03-9c6c-416949017220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'pci_devices' on Instance uuid da332860-2962-4c03-9c6c-416949017220 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:11:33 user nova-compute[75354]:   <uuid>da332860-2962-4c03-9c6c-416949017220</uuid>
Nov 14 07:11:33 user nova-compute[75354]:   <name>instance-00000033</name>
Nov 14 07:11:33 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:11:33 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:11:33 user nova-compute[75354]:   <metadata>
Nov 14 07:11:33 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:11:33 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:11:33 user nova-compute[75354]:       <nova:name>tempest-TestVolumeBootPattern-server-208674996</nova:name>
Nov 14 07:11:33 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:11:32</nova:creationTime>
Nov 14 07:11:33 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:11:33 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:11:33 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:11:33 user nova-compute[75354]:       <nova:owner>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:user uuid="31f9b73f37fb4801aa39ff23e1a095cc">tempest-TestVolumeBootPattern-1643565198-project-member</nova:user>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:project uuid="7c9131ea3f6241aead77fcf82f1e8000">tempest-TestVolumeBootPattern-1643565198</nova:project>
Nov 14 07:11:33 user nova-compute[75354]:       </nova:owner>
Nov 14 07:11:33 user nova-compute[75354]:       <nova:ports>
Nov 14 07:11:33 user nova-compute[75354]:         <nova:port uuid="f5bd5c51-6645-4df0-9446-044dc73e6afe">
Nov 14 07:11:33 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 07:11:33 user nova-compute[75354]:         </nova:port>
Nov 14 07:11:33 user nova-compute[75354]:       </nova:ports>
Nov 14 07:11:33 user nova-compute[75354]:     </nova:instance>
Nov 14 07:11:33 user nova-compute[75354]:   </metadata>
Nov 14 07:11:33 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:11:33 user nova-compute[75354]:     <system>
Nov 14 07:11:33 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:11:33 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:11:33 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:11:33 user nova-compute[75354]:       <entry name="serial">da332860-2962-4c03-9c6c-416949017220</entry>
Nov 14 07:11:33 user nova-compute[75354]:       <entry name="uuid">da332860-2962-4c03-9c6c-416949017220</entry>
Nov 14 07:11:33 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:11:33 user nova-compute[75354]:     </system>
Nov 14 07:11:33 user nova-compute[75354]:   </sysinfo>
Nov 14 07:11:33 user nova-compute[75354]:   <os>
Nov 14 07:11:33 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:11:33 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:11:33 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:11:33 user nova-compute[75354]:   </os>
Nov 14 07:11:33 user nova-compute[75354]:   <features>
Nov 14 07:11:33 user nova-compute[75354]:     <acpi/>
Nov 14 07:11:33 user nova-compute[75354]:     <apic/>
Nov 14 07:11:33 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:11:33 user nova-compute[75354]:   </features>
Nov 14 07:11:33 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:11:33 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:11:33 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:11:33 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:11:33 user nova-compute[75354]:   </clock>
Nov 14 07:11:33 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:11:33 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:11:33 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:11:33 user nova-compute[75354]:   </cpu>
Nov 14 07:11:33 user nova-compute[75354]:   <devices>
Nov 14 07:11:33 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:11:33 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:11:33 user nova-compute[75354]:       <source dev="/dev/sdb"/>
Nov 14 07:11:33 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:11:33 user nova-compute[75354]:       <serial>e07ee897-3f9d-4193-a9cb-d4f8338dec96</serial>
Nov 14 07:11:33 user nova-compute[75354]:     </disk>
Nov 14 07:11:33 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:11:33 user nova-compute[75354]:       <mac address="fa:16:3e:74:ef:37"/>
Nov 14 07:11:33 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:11:33 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:11:33 user nova-compute[75354]:       <target dev="tapf5bd5c51-66"/>
Nov 14 07:11:33 user nova-compute[75354]:     </interface>
Nov 14 07:11:33 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:11:33 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/da332860-2962-4c03-9c6c-416949017220/console.log" append="off"/>
Nov 14 07:11:33 user nova-compute[75354]:     </serial>
Nov 14 07:11:33 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:11:33 user nova-compute[75354]:     <video>
Nov 14 07:11:33 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:11:33 user nova-compute[75354]:     </video>
Nov 14 07:11:33 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:11:33 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:11:33 user nova-compute[75354]:     </rng>
Nov 14 07:11:33 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:11:33 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:11:33 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:11:33 user nova-compute[75354]:     </memballoon>
Nov 14 07:11:33 user nova-compute[75354]:   </devices>
Nov 14 07:11:33 user nova-compute[75354]: </domain>
Nov 14 07:11:33 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-208674996',display_name='tempest-TestVolumeBootPattern-server-208674996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-208674996',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-po4xweqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:11:28Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=da332860-2962-4c03-9c6c-416949017220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG os_vif [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '408ec28d-bb3b-5ee8-913d-4d352702128b', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5bd5c51-66, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5bd5c51-66, col_values=(('qos', UUID('6ac062ca-23aa-4ae8-b702-94e65199856a')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5bd5c51-66, col_values=(('external_ids', {'iface-id': 'f5bd5c51-6645-4df0-9446-044dc73e6afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:ef:37', 'vm-uuid': 'da332860-2962-4c03-9c6c-416949017220'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:33 user nova-compute[75354]: INFO os_vif [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66')
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:11:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No VIF found with MAC fa:16:3e:74:ef:37, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:11:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-af5b3c00-ee66-40be-bcde-a089264f4feb req-8e7a01d7-a38b-45c8-a947-e3b1e606ad39 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af5b3c00-ee66-40be-bcde-a089264f4feb req-8e7a01d7-a38b-45c8-a947-e3b1e606ad39 service nova] Acquiring lock "da332860-2962-4c03-9c6c-416949017220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af5b3c00-ee66-40be-bcde-a089264f4feb req-8e7a01d7-a38b-45c8-a947-e3b1e606ad39 service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af5b3c00-ee66-40be-bcde-a089264f4feb req-8e7a01d7-a38b-45c8-a947-e3b1e606ad39 service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG nova.compute.manager [req-af5b3c00-ee66-40be-bcde-a089264f4feb req-8e7a01d7-a38b-45c8-a947-e3b1e606ad39 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] No waiting events found dispatching network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:11:35 user nova-compute[75354]: WARNING nova.compute.manager [req-af5b3c00-ee66-40be-bcde-a089264f4feb req-8e7a01d7-a38b-45c8-a947-e3b1e606ad39 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received unexpected event network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe for instance with vm_state building and task_state spawning.
Nov 14 07:11:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:11:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 07:11:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:11:37 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: da332860-2962-4c03-9c6c-416949017220] Instance spawned successfully.
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:11:37 user nova-compute[75354]: INFO nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-a83dbcec-2c24-4c1d-961d-09eb6dd13642 req-9415ad61-9e3e-40b6-9fb0-a95d005bdc4e service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a83dbcec-2c24-4c1d-961d-09eb6dd13642 req-9415ad61-9e3e-40b6-9fb0-a95d005bdc4e service nova] Acquiring lock "da332860-2962-4c03-9c6c-416949017220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a83dbcec-2c24-4c1d-961d-09eb6dd13642 req-9415ad61-9e3e-40b6-9fb0-a95d005bdc4e service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-a83dbcec-2c24-4c1d-961d-09eb6dd13642 req-9415ad61-9e3e-40b6-9fb0-a95d005bdc4e service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-a83dbcec-2c24-4c1d-961d-09eb6dd13642 req-9415ad61-9e3e-40b6-9fb0-a95d005bdc4e service nova] [instance: da332860-2962-4c03-9c6c-416949017220] No waiting events found dispatching network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:11:37 user nova-compute[75354]: WARNING nova.compute.manager [req-a83dbcec-2c24-4c1d-961d-09eb6dd13642 req-9415ad61-9e3e-40b6-9fb0-a95d005bdc4e service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received unexpected event network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe for instance with vm_state building and task_state spawning.
Nov 14 07:11:37 user nova-compute[75354]: INFO nova.compute.manager [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Took 10.05 seconds to build instance.
Nov 14 07:11:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77a7447f-d404-4d9c-8ae4-97dd3a418704 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "da332860-2962-4c03-9c6c-416949017220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.144s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-changed-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Refreshing instance network info cache due to event network-changed-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] Acquiring lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] Acquired lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Refreshing network info cache for port 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:11:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updated VIF entry in instance network info cache for port 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:11:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating instance_info_cache with network_info: [{"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:11:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-08ca2010-22b5-44cf-adc7-ba69dc09398a req-5dbd4fd3-1c38-4a51-98e3-65dcb55258d6 service nova] Releasing lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:11:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG nova.objects.instance [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'flavor' on Instance uuid e46664cf-afee-42c7-9b08-92f3400ccb53 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:39 user nova-compute[75354]: INFO nova.compute.manager [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Attaching volume eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc to /dev/vdb
Nov 14 07:11:39 user nova-compute[75354]: DEBUG os_brick.utils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21fda38-2c9f-40a3-ba10-cfffe909d594]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea2b46a-66aa-415b-ae70-dbf1fef4e3cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e8c761-fe78-4f5a-83be-224b5a3cc0e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a02c045-5b29-4d9e-930e-b28755a3d161]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:11:39 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:11:39 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2b923-7b65-4c00-bb54-28fd4772b04f]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG os_brick.utils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:11:39 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating existing volume attachment record: bf715b77-2f78-41c5-8ce0-55322b20aed3 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYzRFkmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:11:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:11:43 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:11:43 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[644088a8-9b0b-47ef-95a3-e10551ddb2a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:11:43 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7480d23-df7c-411a-a258-ed173ef56686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc] added
Nov 14 07:11:43 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f562da8b-457f-43a4-8800-9415ca2fadf6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:43 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f683ba9-e6b2-4818-916b-f4bda3a53c5f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYzRFkmH {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYzRFkmH" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4924ca4-a4ff-440e-abf5-6b69513687dd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYzRFkmH'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dbafa4-756c-4a07-81f3-50953c4a861a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9627d6-1453-4a5d-8d05-5c9330571613]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5c53d8-8231-4b59-9c37-adaa523c0ab6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260]
Nov 14 07:11:44 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260] successful.
Nov 14 07:11:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d88f6e-57e2-41d2-826c-88566ac5b7b1]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f5c060-42fd-49cc-8e91-7d7913a72a7b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:44 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:11:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:44 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:11:44 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[939a6b5f-e2d6-453c-9c2e-20ef9b5cdeb2]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYzRFkmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:11:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23230336263636163', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230336263636163', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'flavor' on Instance uuid e46664cf-afee-42c7-9b08-92f3400ccb53 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:11:45 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:11:45 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 07:11:45 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:11:45 user nova-compute[75354]:   <serial>eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc</serial>
Nov 14 07:11:45 user nova-compute[75354]: </disk>
Nov 14 07:11:45 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] No VIF found with MAC fa:16:3e:3e:95:1b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:11:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-465c6128-301e-404b-bda7-a12b8a470807 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:47 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:47 user nova-compute[75354]: INFO nova.compute.manager [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Detaching volume eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc
Nov 14 07:11:47 user nova-compute[75354]: INFO nova.virt.block_device [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Attempting to driver detach volume eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc from mountpoint /dev/vdb
Nov 14 07:11:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Attempting to detach device vdb from instance e46664cf-afee-42c7-9b08-92f3400ccb53 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:11:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:11:47 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:11:47 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 07:11:47 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:11:47 user nova-compute[75354]:   <serial>eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc</serial>
Nov 14 07:11:47 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:11:47 user nova-compute[75354]: </disk>
Nov 14 07:11:47 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:11:47 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully detached device vdb from instance e46664cf-afee-42c7-9b08-92f3400ccb53 from the persistent domain config.
Nov 14 07:11:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e46664cf-afee-42c7-9b08-92f3400ccb53 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:11:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:11:47 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:11:47 user nova-compute[75354]:   <source dev="/dev/sdc"/>
Nov 14 07:11:47 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:11:47 user nova-compute[75354]:   <serial>eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc</serial>
Nov 14 07:11:47 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:11:47 user nova-compute[75354]: </disk>
Nov 14 07:11:47 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:11:47 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e46664cf-afee-42c7-9b08-92f3400ccb53 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'flavor' on Instance uuid fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:48 user nova-compute[75354]: INFO nova.compute.manager [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Attaching volume d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 to /dev/vdb
Nov 14 07:11:48 user nova-compute[75354]: DEBUG os_brick.utils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2ca73-ca4f-4698-812f-fdd7b9a31960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[da804702-2e16-406a-b05b-366f2b7c797f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[986028b2-fbb0-41d5-bc54-e5f236244958]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83208f25-bcba-4293-a325-2001c292dcfa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:11:48 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:11:48 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6da4d4-82b2-4db6-b4fb-c72c28c7ad77]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG os_brick.utils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:11:48 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating existing volume attachment record: b43644f5-29c3-435f-ac84-1393d5695bfc {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:11:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaDSRirp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:11:53 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:11:53 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:11:53 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d56c7-7edc-45d2-aa5f-d498681dbba3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:11:53 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7459b-1553-4e39-a98d-518dd2d88460]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12] added
Nov 14 07:11:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d1dca-e970-4ace-81d5-0d8333ba2f9e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d3bbe7-753b-4449-98a8-e6210af461f8]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EaDSRirp {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EaDSRirp" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b2562a-21e4-49a4-8188-bed88628164b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EaDSRirp'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1197b92-4125-424d-8bf6-b1bbb891bf7f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8d15b-97a9-40ca-864c-20c0983a37d5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:53 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:11:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:53 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:11:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46b31a-7168-44ce-bd28-9bd5f0430068]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260]
Nov 14 07:11:53 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260] successful.
Nov 14 07:11:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb0bd28-8468-4ff4-b952-59958e63be57]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0ac629-053a-42b2-9dc4-05ce75cc93e0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:53 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:11:53 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:11:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:11:53 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:11:53 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:11:53 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] HCTL ('35', '-', '-', 0) found on session 62 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e3ced-00f6-4a33-a4f6-570e5cdd1a70]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaDSRirp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:11:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26363663832643637', 'path': '/dev/sdd'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363663832643637', 'path': '/dev/sdd'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG nova.objects.instance [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'flavor' on Instance uuid fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:11:54 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:11:54 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 07:11:54 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:11:54 user nova-compute[75354]:   <serial>d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12</serial>
Nov 14 07:11:54 user nova-compute[75354]: </disk>
Nov 14 07:11:54 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] No VIF found with MAC fa:16:3e:cb:ac:0b, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:11:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-f52d1529-a403-4a3e-a325-c9ae85468472 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.401s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:11:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:11:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing instance network info cache due to event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:11:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:11:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated VIF entry in instance network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:11:57 user nova-compute[75354]: DEBUG nova.network.neutron [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:11:57 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-af139f03-abea-4ec0-99eb-7f7f42b13c8f req-ad9e1d4a-8ef1-43aa-bf76-e6bcd4ff181f service nova] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:11:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG nova.compute.manager [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing instance network info cache due to event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated VIF entry in instance network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG nova.network.neutron [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-754d6388-a23f-4009-ac0f-522f6be1f84b req-a2ac3d27-5d54-4288-9b8a-0d5f754225e2 service nova] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:11:59 user nova-compute[75354]: INFO nova.compute.manager [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Rebooting instance
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:11:59 user nova-compute[75354]: DEBUG nova.network.neutron [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:12:00 user nova-compute[75354]: DEBUG nova.network.neutron [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:12:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:12:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-d93b2be0-53e1-492c-8082-b2a2ae76f1a9 req-371341c6-55e7-4fed-9a46-a44c78e500f2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-unplugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d93b2be0-53e1-492c-8082-b2a2ae76f1a9 req-371341c6-55e7-4fed-9a46-a44c78e500f2 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d93b2be0-53e1-492c-8082-b2a2ae76f1a9 req-371341c6-55e7-4fed-9a46-a44c78e500f2 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d93b2be0-53e1-492c-8082-b2a2ae76f1a9 req-371341c6-55e7-4fed-9a46-a44c78e500f2 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:02 user nova-compute[75354]: DEBUG nova.compute.manager [req-d93b2be0-53e1-492c-8082-b2a2ae76f1a9 req-371341c6-55e7-4fed-9a46-a44c78e500f2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-unplugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:12:02 user nova-compute[75354]: WARNING nova.compute.manager [req-d93b2be0-53e1-492c-8082-b2a2ae76f1a9 req-371341c6-55e7-4fed-9a46-a44c78e500f2 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-unplugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state active and task_state reboot_started.
Nov 14 07:12:03 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance shutdown successfully.
Nov 14 07:12:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-c6cee0d3-af0f-42ea-8fd2-f728d876bcbe req-3679997a-45ac-49e6-b4e2-0f3b5000e968 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c6cee0d3-af0f-42ea-8fd2-f728d876bcbe req-3679997a-45ac-49e6-b4e2-0f3b5000e968 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c6cee0d3-af0f-42ea-8fd2-f728d876bcbe req-3679997a-45ac-49e6-b4e2-0f3b5000e968 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c6cee0d3-af0f-42ea-8fd2-f728d876bcbe req-3679997a-45ac-49e6-b4e2-0f3b5000e968 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:04 user nova-compute[75354]: DEBUG nova.compute.manager [req-c6cee0d3-af0f-42ea-8fd2-f728d876bcbe req-3679997a-45ac-49e6-b4e2-0f3b5000e968 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:12:04 user nova-compute[75354]: WARNING nova.compute.manager [req-c6cee0d3-af0f-42ea-8fd2-f728d876bcbe req-3679997a-45ac-49e6-b4e2-0f3b5000e968 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state active and task_state reboot_started.
Nov 14 07:12:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance running successfully.
Nov 14 07:12:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance soft rebooted successfully.
Nov 14 07:12:06 user nova-compute[75354]: DEBUG nova.compute.manager [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-348906fd-c3fc-45a9-8ea4-aa8c255e32d1 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.091s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:12:06 user nova-compute[75354]: WARNING nova.compute.manager [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state active and task_state None.
Nov 14 07:12:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:06 user nova-compute[75354]: DEBUG nova.compute.manager [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:12:06 user nova-compute[75354]: WARNING nova.compute.manager [req-e08f1fce-8c30-4872-b87b-455f2baccc94 req-b88e5445-786d-40e6-b65f-f9a8efdf3262 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state active and task_state None.
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:12:07 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e46664cf-afee-42c7-9b08-92f3400ccb53 is timed out.
Nov 14 07:12:07 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully detached device vdb from instance e46664cf-afee-42c7-9b08-92f3400ccb53 from the live domain config.
Nov 14 07:12:07 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYzRFkmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:12:07 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e6ebb7-d288-4f6d-a980-f7bd5feae0e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:12:07 user nova-compute[75354]: No targets found.
Nov 14 07:12:07 user nova-compute[75354]: iSNS:
Nov 14 07:12:07 user nova-compute[75354]: No targets found.
Nov 14 07:12:07 user nova-compute[75354]: STATIC:
Nov 14 07:12:07 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc
Nov 14 07:12:07 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:12:07 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:12:07 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96
Nov 14 07:12:07 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:12:07 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:12:07 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12
Nov 14 07:12:07 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:12:07 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:12:07 user nova-compute[75354]: FIRMWARE:
Nov 14 07:12:07 user nova-compute[75354]: No targets found.
Nov 14 07:12:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:12:07 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:12:07 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[122dc320-19f5-46f8-b2fb-b441afa3d181]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99898f7-f827-4dc7-b1ff-5eda2d3c5a10]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:12:07 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:12:07 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:12:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:12:07 user nova-compute[75354]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc (non-flash)
Nov 14 07:12:07 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:12:07 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f807410f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511821e-d175-4ab6-9d36-9b1ed5a23578]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:07 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b6db83-dd1d-42ae-abf0-ffbda8e4799c]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a472a7-ebd3-4f1b-b47d-8b6242a470db]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1526b6fc-1570-4843-ab86-7f1597f32bdd]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[875616db-2eb6-46b0-a822-ee0ced170298]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b966e3c-e9bf-41f8-9b7e-d1944cc89f05]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260]
Nov 14 07:12:08 user nova-compute[75354]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc, portal: 172.16.0.220,3260] successful.
Nov 14 07:12:08 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaf0c4-8f00-4042-b73b-2b24f4fc32bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74acdf8-f134-4dd1-87d0-31d989a17370]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] <== disconnect_volume: return (321ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG nova.objects.instance [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'flavor' on Instance uuid e46664cf-afee-42c7-9b08-92f3400ccb53 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:12:08 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-bb2d1e2e-9960-4f35-a387-7a2af4b571d0 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:12:09 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=24.98963165283203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance e46664cf-afee-42c7-9b08-92f3400ccb53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance fb07d140-7b51-4db2-8acf-a034a38c9d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance da332860-2962-4c03-9c6c-416949017220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:12:09 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:12:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating instance_info_cache with network_info: [{"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:12:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:12:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:14 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:12:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:12:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-changed-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:37 user nova-compute[75354]: DEBUG nova.compute.manager [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Refreshing instance network info cache due to event network-changed-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:12:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] Acquiring lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:12:37 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] Acquired lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:12:37 user nova-compute[75354]: DEBUG nova.network.neutron [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Refreshing network info cache for port 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:38 user nova-compute[75354]: INFO nova.compute.manager [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Terminating instance
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.compute.manager [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-f39d6bd5-be00-4481-85ef-79a2fd03e3f0 req-469f224f-9850-4dc6-9b58-43a2547ba141 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-vif-unplugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f39d6bd5-be00-4481-85ef-79a2fd03e3f0 req-469f224f-9850-4dc6-9b58-43a2547ba141 service nova] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f39d6bd5-be00-4481-85ef-79a2fd03e3f0 req-469f224f-9850-4dc6-9b58-43a2547ba141 service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f39d6bd5-be00-4481-85ef-79a2fd03e3f0 req-469f224f-9850-4dc6-9b58-43a2547ba141 service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-f39d6bd5-be00-4481-85ef-79a2fd03e3f0 req-469f224f-9850-4dc6-9b58-43a2547ba141 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] No waiting events found dispatching network-vif-unplugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.compute.manager [req-f39d6bd5-be00-4481-85ef-79a2fd03e3f0 req-469f224f-9850-4dc6-9b58-43a2547ba141 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-vif-unplugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updated VIF entry in instance network info cache for port 3e6ae7b4-a793-41a9-93bd-60c38d26c0ab. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.network.neutron [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating instance_info_cache with network_info: [{"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-030177e9-22e4-4ee1-9516-460052b7c8d8 req-4d65ada6-03ca-47c5-84a5-3d24fd0e7cc7 service nova] Releasing lock "refresh_cache-e46664cf-afee-42c7-9b08-92f3400ccb53" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Instance destroyed successfully.
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.objects.instance [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'resources' on Instance uuid e46664cf-afee-42c7-9b08-92f3400ccb53 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-891390626',display_name='tempest-TestStampPattern-server-891390626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-891390626',id=49,image_ref='638b358c-982a-40f0-8295-8606a7df6d19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9t9VYWd1w1dsE+gtMxAxCDrgdh8uSqCFxyqRujjNTBg9BhjvhPHxhc5Hbega0R2r7w1Mh+1Zr1v4G2YbTCuJoHwZxbfPwidU68dZic+8yKh1krNGcE+gx/CEdM8FlqsA==',key_name='tempest-TestStampPattern-916007887',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68c7f91ccf4d439e8506edf2fb082d19',ramdisk_id='',reservation_id='r-lxxk3hn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ba82e598-3677-4102-b365-2531ac3b3156',image_min_disk='1',image_min_ram='0',image_owner_id='68c7f91ccf4d439e8506edf2fb082d19',image_owner_project_name='tempest-TestStampPattern-1904450519',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1904450519-project-member',image_user_id='c1f45b056e334f89bd5dc2f08cf00c3c',owner_project_name='tempest-TestStampPattern-1904450519',owner_user_name='tempest-TestStampPattern-1904450519-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:09:52Z,user_data=None,user_id='c1f45b056e334f89bd5dc2f08cf00c3c',uuid=e46664cf-afee-42c7-9b08-92f3400ccb53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converting VIF {"id": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "address": "fa:16:3e:3e:95:1b", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6ae7b4-a7", "ovs_interfaceid": "3e6ae7b4-a793-41a9-93bd-60c38d26c0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG os_vif [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e6ae7b4-a7, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea6e28a4-44b5-44f3-947f-c2546202490e) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:38 user nova-compute[75354]: INFO os_vif [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e6ae7b4-a793-41a9-93bd-60c38d26c0ab,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6ae7b4-a7')
Nov 14 07:12:38 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Deleting instance files /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53_del
Nov 14 07:12:38 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Deletion of /opt/stack/data/nova/instances/e46664cf-afee-42c7-9b08-92f3400ccb53_del complete
Nov 14 07:12:38 user nova-compute[75354]: INFO nova.compute.manager [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 07:12:38 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:12:38 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:12:39 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Took 0.51 seconds to deallocate network for instance.
Nov 14 07:12:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:12:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:39 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Deleted allocations for instance e46664cf-afee-42c7-9b08-92f3400ccb53
Nov 14 07:12:39 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-68903e23-61e5-4f3c-be3d-0666fefa6525 tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] Acquiring lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:12:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:12:40 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] Lock "e46664cf-afee-42c7-9b08-92f3400ccb53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:12:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] No waiting events found dispatching network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:12:40 user nova-compute[75354]: WARNING nova.compute.manager [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received unexpected event network-vif-plugged-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab for instance with vm_state deleted and task_state None.
Nov 14 07:12:40 user nova-compute[75354]: DEBUG nova.compute.manager [req-4ca41ea7-30cc-47e1-b4f7-11a1310d9760 req-c6fca678-2c03-428a-83fe-c9b15fbf6c96 service nova] [instance: e46664cf-afee-42c7-9b08-92f3400ccb53] Received event network-vif-deleted-3e6ae7b4-a793-41a9-93bd-60c38d26c0ab {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:12:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:12:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:12:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:12:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:12:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:12:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:12:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:12:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:12:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:05 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:06 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:07 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:13:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:13:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:13:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:13:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:09 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:10 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:13:10 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=24.98990249633789GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance ba82e598-3677-4102-b365-2531ac3b3156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance fb07d140-7b51-4db2-8acf-a034a38c9d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance da332860-2962-4c03-9c6c-416949017220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:13:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:13:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:13:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:13:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:14 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:13:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-changed-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:18 user nova-compute[75354]: DEBUG nova.compute.manager [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Refreshing instance network info cache due to event network-changed-f5bd5c51-6645-4df0-9446-044dc73e6afe. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:13:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] Acquiring lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] Acquired lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:18 user nova-compute[75354]: DEBUG nova.network.neutron [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Refreshing network info cache for port f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:13:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:19 user nova-compute[75354]: DEBUG nova.network.neutron [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Updated VIF entry in instance network info cache for port f5bd5c51-6645-4df0-9446-044dc73e6afe. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:13:19 user nova-compute[75354]: DEBUG nova.network.neutron [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Updating instance_info_cache with network_info: [{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f3cfa335-fa1d-4b85-97c7-1eb097dcbec9 req-4ad1b64e-d728-4b30-91fb-98fea367fed8 service nova] Releasing lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:13:23 user nova-compute[75354]: INFO nova.compute.claims [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Claim successful on node user
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:13:23 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG nova.policy [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f9b73f37fb4801aa39ff23e1a095cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9131ea3f6241aead77fcf82f1e8000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:13:23 user nova-compute[75354]: INFO nova.virt.block_device [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Booting with volume d4aa0013-67e9-46c0-af29-e3581ae0752a at /dev/vda
Nov 14 07:13:23 user nova-compute[75354]: DEBUG os_brick.utils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[08efd0c1-c2a9-4af7-b241-088344a65039]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7915699-06f2-4a25-bce1-44a9bee493e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3b75f-6fb7-4207-a4f1-b20d364ef396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffec88ab-0592-4ba2-895f-f7640af02108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:13:24 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:13:24 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17f34a-ff5e-41ff-8088-b23ed0d7b4ae]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG os_brick.utils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updating existing volume attachment record: ca1f6ade-9dbe-4262-b09d-3a904776bbef {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Successfully created port: 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Successfully updated port: 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquired lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-changed-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG nova.compute.manager [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Refreshing instance network info cache due to event network-changed-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] Acquiring lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:25 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG nova.network.neutron [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updating instance_info_cache with network_info: [{"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Releasing lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Instance network_info: |[{"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] Acquired lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Refreshing network info cache for port 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updated VIF entry in instance network info cache for port 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG nova.network.neutron [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updating instance_info_cache with network_info: [{"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:26 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-6f2bb7cf-5d50-4b42-81df-ec30f358668c req-e7862d7f-f971-4292-aec0-8d66b0bd86e8 service nova] Releasing lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:13:28 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Creating image(s)
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Did not create local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Ensure instance console log exists: /opt/stack/data/nova/instances/05d00290-377f-47c1-baaa-a3bfb73f9150/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Start _get_guest_xml network_info=[{"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHNqcpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05d00290-377f-47c1-baaa-a3bfb73f9150', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4aa0013-67e9-46c0-af29-e3581ae0752a', 'serial': 'd4aa0013-67e9-46c0-af29-e3581ae0752a'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'ca1f6ade-9dbe-4262-b09d-3a904776bbef', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:13:28 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:13:28 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHNqcpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:13:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:13:28 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:13:28 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[42813c2c-8d93-454d-9f59-68aa316035a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:13:28 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf13ec5-90ff-49dd-95b3-9f57e8cd3ea9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a] added
Nov 14 07:13:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f02ff-5407-47c3-b683-dd33d986defd]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e5399-db3c-4d92-a918-1e3832e94e68]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biHNqcpC {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biHNqcpC" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7cfc76-d5ca-4e22-ad1f-8e06fb0916b6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'biHNqcpC'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f03bb9-b3c8-4a17-ae97-dd8821137703]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1da173-a304-4d53-b414-7a95634acbae]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de69e14-82c2-499b-932a-c7d776482ffd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260]
Nov 14 07:13:28 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260] successful.
Nov 14 07:13:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680c66c-bbb3-4f52-bd70-5b3a951cead6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3443d9-8acd-48c0-82e7-ae2647383bcc]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)
Nov 14 07:13:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:13:28 user nova-compute[75354]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)
Nov 14 07:13:28 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e870d2-4155-4efe-b2fe-a046a87d238a]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:13:28 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHNqcpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26236366266613730', 'path': '/dev/sdc'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236366266613730', 'path': '/dev/sdc'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1560718656',display_name='tempest-TestVolumeBootPattern-server-1560718656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1560718656',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-jb4eo15e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:13:24Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=05d00290-377f-47c1-baaa-a3bfb73f9150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'pci_devices' on Instance uuid 05d00290-377f-47c1-baaa-a3bfb73f9150 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:13:29 user nova-compute[75354]:   <uuid>05d00290-377f-47c1-baaa-a3bfb73f9150</uuid>
Nov 14 07:13:29 user nova-compute[75354]:   <name>instance-00000034</name>
Nov 14 07:13:29 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:13:29 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:13:29 user nova-compute[75354]:   <metadata>
Nov 14 07:13:29 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:13:29 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:13:29 user nova-compute[75354]:       <nova:name>tempest-TestVolumeBootPattern-server-1560718656</nova:name>
Nov 14 07:13:29 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:13:28</nova:creationTime>
Nov 14 07:13:29 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:13:29 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:13:29 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:13:29 user nova-compute[75354]:       <nova:owner>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:user uuid="31f9b73f37fb4801aa39ff23e1a095cc">tempest-TestVolumeBootPattern-1643565198-project-member</nova:user>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:project uuid="7c9131ea3f6241aead77fcf82f1e8000">tempest-TestVolumeBootPattern-1643565198</nova:project>
Nov 14 07:13:29 user nova-compute[75354]:       </nova:owner>
Nov 14 07:13:29 user nova-compute[75354]:       <nova:ports>
Nov 14 07:13:29 user nova-compute[75354]:         <nova:port uuid="71b4f6cb-b23e-4947-8b4b-4c37bd53ee08">
Nov 14 07:13:29 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 07:13:29 user nova-compute[75354]:         </nova:port>
Nov 14 07:13:29 user nova-compute[75354]:       </nova:ports>
Nov 14 07:13:29 user nova-compute[75354]:     </nova:instance>
Nov 14 07:13:29 user nova-compute[75354]:   </metadata>
Nov 14 07:13:29 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:13:29 user nova-compute[75354]:     <system>
Nov 14 07:13:29 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:13:29 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:13:29 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:13:29 user nova-compute[75354]:       <entry name="serial">05d00290-377f-47c1-baaa-a3bfb73f9150</entry>
Nov 14 07:13:29 user nova-compute[75354]:       <entry name="uuid">05d00290-377f-47c1-baaa-a3bfb73f9150</entry>
Nov 14 07:13:29 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:13:29 user nova-compute[75354]:     </system>
Nov 14 07:13:29 user nova-compute[75354]:   </sysinfo>
Nov 14 07:13:29 user nova-compute[75354]:   <os>
Nov 14 07:13:29 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:13:29 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:13:29 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:13:29 user nova-compute[75354]:   </os>
Nov 14 07:13:29 user nova-compute[75354]:   <features>
Nov 14 07:13:29 user nova-compute[75354]:     <acpi/>
Nov 14 07:13:29 user nova-compute[75354]:     <apic/>
Nov 14 07:13:29 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:13:29 user nova-compute[75354]:   </features>
Nov 14 07:13:29 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:13:29 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:13:29 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:13:29 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:13:29 user nova-compute[75354]:   </clock>
Nov 14 07:13:29 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:13:29 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:13:29 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:13:29 user nova-compute[75354]:   </cpu>
Nov 14 07:13:29 user nova-compute[75354]:   <devices>
Nov 14 07:13:29 user nova-compute[75354]:     <disk type="block" device="disk">
Nov 14 07:13:29 user nova-compute[75354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:13:29 user nova-compute[75354]:       <source dev="/dev/sdc"/>
Nov 14 07:13:29 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:13:29 user nova-compute[75354]:       <serial>d4aa0013-67e9-46c0-af29-e3581ae0752a</serial>
Nov 14 07:13:29 user nova-compute[75354]:     </disk>
Nov 14 07:13:29 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:13:29 user nova-compute[75354]:       <mac address="fa:16:3e:40:c5:da"/>
Nov 14 07:13:29 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:13:29 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:13:29 user nova-compute[75354]:       <target dev="tap71b4f6cb-b2"/>
Nov 14 07:13:29 user nova-compute[75354]:     </interface>
Nov 14 07:13:29 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:13:29 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/05d00290-377f-47c1-baaa-a3bfb73f9150/console.log" append="off"/>
Nov 14 07:13:29 user nova-compute[75354]:     </serial>
Nov 14 07:13:29 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:13:29 user nova-compute[75354]:     <video>
Nov 14 07:13:29 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:13:29 user nova-compute[75354]:     </video>
Nov 14 07:13:29 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:13:29 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:13:29 user nova-compute[75354]:     </rng>
Nov 14 07:13:29 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:13:29 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:13:29 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:13:29 user nova-compute[75354]:     </memballoon>
Nov 14 07:13:29 user nova-compute[75354]:   </devices>
Nov 14 07:13:29 user nova-compute[75354]: </domain>
Nov 14 07:13:29 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1560718656',display_name='tempest-TestVolumeBootPattern-server-1560718656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1560718656',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-jb4eo15e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:13:24Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=05d00290-377f-47c1-baaa-a3bfb73f9150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG os_vif [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edaa56e4-7042-55e5-8e1d-3c6cd004ecc1', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71b4f6cb-b2, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71b4f6cb-b2, col_values=(('qos', UUID('9861f8a6-dfd7-4149-a3b6-45716a3d397f')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71b4f6cb-b2, col_values=(('external_ids', {'iface-id': '71b4f6cb-b23e-4947-8b4b-4c37bd53ee08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:c5:da', 'vm-uuid': '05d00290-377f-47c1-baaa-a3bfb73f9150'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:29 user nova-compute[75354]: INFO os_vif [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2')
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:13:29 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] No VIF found with MAC fa:16:3e:40:c5:da, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-759a95f9-7517-48f7-9591-67a1e20e4c0a req-378b216c-87d0-4d58-827e-cf9818ec0cf6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-759a95f9-7517-48f7-9591-67a1e20e4c0a req-378b216c-87d0-4d58-827e-cf9818ec0cf6 service nova] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-759a95f9-7517-48f7-9591-67a1e20e4c0a req-378b216c-87d0-4d58-827e-cf9818ec0cf6 service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-759a95f9-7517-48f7-9591-67a1e20e4c0a req-378b216c-87d0-4d58-827e-cf9818ec0cf6 service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:31 user nova-compute[75354]: DEBUG nova.compute.manager [req-759a95f9-7517-48f7-9591-67a1e20e4c0a req-378b216c-87d0-4d58-827e-cf9818ec0cf6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] No waiting events found dispatching network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:13:31 user nova-compute[75354]: WARNING nova.compute.manager [req-759a95f9-7517-48f7-9591-67a1e20e4c0a req-378b216c-87d0-4d58-827e-cf9818ec0cf6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received unexpected event network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 for instance with vm_state building and task_state spawning.
Nov 14 07:13:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-changed-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG nova.compute.manager [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Refreshing instance network info cache due to event network-changed-4371760e-6d4d-4524-8ab8-301c682b286c. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] Acquiring lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] Acquired lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG nova.network.neutron [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Refreshing network info cache for port 4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:32 user nova-compute[75354]: INFO nova.compute.manager [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Terminating instance
Nov 14 07:13:32 user nova-compute[75354]: DEBUG nova.compute.manager [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updated VIF entry in instance network info cache for port 4371760e-6d4d-4524-8ab8-301c682b286c. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.network.neutron [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [{"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-014de5d5-eaf8-4faa-8cb5-94d17f98833d req-182592b6-4caa-4faa-b305-84ad4e54686f service nova] Releasing lock "refresh_cache-ba82e598-3677-4102-b365-2531ac3b3156" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Instance spawned successfully.
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.compute.manager [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Took 10.01 seconds to build instance.
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8462ce3-1955-46e9-8179-ee758137ecb5 req-3d6a88f1-aee5-47ff-8a9e-07e96db04515 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8462ce3-1955-46e9-8179-ee758137ecb5 req-3d6a88f1-aee5-47ff-8a9e-07e96db04515 service nova] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8462ce3-1955-46e9-8179-ee758137ecb5 req-3d6a88f1-aee5-47ff-8a9e-07e96db04515 service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8462ce3-1955-46e9-8179-ee758137ecb5 req-3d6a88f1-aee5-47ff-8a9e-07e96db04515 service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8462ce3-1955-46e9-8179-ee758137ecb5 req-3d6a88f1-aee5-47ff-8a9e-07e96db04515 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] No waiting events found dispatching network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:13:33 user nova-compute[75354]: WARNING nova.compute.manager [req-c8462ce3-1955-46e9-8179-ee758137ecb5 req-3d6a88f1-aee5-47ff-8a9e-07e96db04515 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received unexpected event network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 for instance with vm_state building and task_state spawning.
Nov 14 07:13:33 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba16b8ea-7123-4335-81bb-a1e38a2f08be tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.132s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Instance destroyed successfully.
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.objects.instance [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lazy-loading 'resources' on Instance uuid ba82e598-3677-4102-b365-2531ac3b3156 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-571207146',display_name='tempest-TestStampPattern-server-571207146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-571207146',id=47,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9t9VYWd1w1dsE+gtMxAxCDrgdh8uSqCFxyqRujjNTBg9BhjvhPHxhc5Hbega0R2r7w1Mh+1Zr1v4G2YbTCuJoHwZxbfPwidU68dZic+8yKh1krNGcE+gx/CEdM8FlqsA==',key_name='tempest-TestStampPattern-916007887',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68c7f91ccf4d439e8506edf2fb082d19',ramdisk_id='',reservation_id='r-wwa9es18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1904450519',owner_user_name='tempest-TestStampPattern-1904450519-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:09:44Z,user_data=None,user_id='c1f45b056e334f89bd5dc2f08cf00c3c',uuid=ba82e598-3677-4102-b365-2531ac3b3156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converting VIF {"id": "4371760e-6d4d-4524-8ab8-301c682b286c", "address": "fa:16:3e:f4:c8:01", "network": {"id": "77f23d8f-6672-4474-b53c-c6632252d275", "bridge": "br-int", "label": "tempest-TestStampPattern-1601534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c7f91ccf4d439e8506edf2fb082d19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4371760e-6d", "ovs_interfaceid": "4371760e-6d4d-4524-8ab8-301c682b286c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG os_vif [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4371760e-6d, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5764b00c-b4a9-4d73-bebc-4fc11bc924d2) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:33 user nova-compute[75354]: INFO os_vif [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:c8:01,bridge_name='br-int',has_traffic_filtering=True,id=4371760e-6d4d-4524-8ab8-301c682b286c,network=Network(77f23d8f-6672-4474-b53c-c6632252d275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4371760e-6d')
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Deleting instance files /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156_del
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Deletion of /opt/stack/data/nova/instances/ba82e598-3677-4102-b365-2531ac3b3156_del complete
Nov 14 07:13:33 user nova-compute[75354]: INFO nova.compute.manager [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 07:13:33 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:13:33 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: ba82e598-3677-4102-b365-2531ac3b3156] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:34 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Took 0.45 seconds to deallocate network for instance.
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-f5c52210-c390-403b-ab5c-9b04b5a36619 req-30453613-b70e-4ad5-8fc9-e49c01f6dd4e service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-vif-deleted-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:34 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Deleted allocations for instance ba82e598-3677-4102-b365-2531ac3b3156
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-843a5abb-8465-4e43-b436-92b216c6018b tempest-TestStampPattern-1904450519 tempest-TestStampPattern-1904450519-project-member] Lock "ba82e598-3677-4102-b365-2531ac3b3156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-vif-unplugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] No waiting events found dispatching network-vif-unplugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:13:34 user nova-compute[75354]: WARNING nova.compute.manager [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received unexpected event network-vif-unplugged-4371760e-6d4d-4524-8ab8-301c682b286c for instance with vm_state deleted and task_state None.
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received event network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] Acquiring lock "ba82e598-3677-4102-b365-2531ac3b3156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] Lock "ba82e598-3677-4102-b365-2531ac3b3156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:13:34 user nova-compute[75354]: DEBUG nova.compute.manager [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] No waiting events found dispatching network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:13:34 user nova-compute[75354]: WARNING nova.compute.manager [req-049eb3fc-332f-48dc-985d-9cb76eaf59e8 req-e7939015-adcd-4139-a715-a2df49f4344b service nova] [instance: ba82e598-3677-4102-b365-2531ac3b3156] Received unexpected event network-vif-plugged-4371760e-6d4d-4524-8ab8-301c682b286c for instance with vm_state deleted and task_state None.
Nov 14 07:13:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:48 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:13:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing instance network info cache due to event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated VIF entry in instance network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-d577a206-53aa-4d6c-a33f-aa3d6f7f27d4 req-993f1706-d637-4336-a9fa-3df888e2f58e service nova] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.compute.manager [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing instance network info cache due to event network-changed-ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG nova.network.neutron [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Refreshing network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:13:51 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:13:51 user nova-compute[75354]: INFO nova.compute.manager [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Detaching volume d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12
Nov 14 07:13:52 user nova-compute[75354]: INFO nova.virt.block_device [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Attempting to driver detach volume d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 from mountpoint /dev/vdb
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Attempting to detach device vdb from instance fb07d140-7b51-4db2-8acf-a034a38c9d9e from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:13:52 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:13:52 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 07:13:52 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:13:52 user nova-compute[75354]:   <serial>d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12</serial>
Nov 14 07:13:52 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:13:52 user nova-compute[75354]: </disk>
Nov 14 07:13:52 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:13:52 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully detached device vdb from instance fb07d140-7b51-4db2-8acf-a034a38c9d9e from the persistent domain config.
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb07d140-7b51-4db2-8acf-a034a38c9d9e from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:13:52 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:13:52 user nova-compute[75354]:   <source dev="/dev/sdd"/>
Nov 14 07:13:52 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:13:52 user nova-compute[75354]:   <serial>d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12</serial>
Nov 14 07:13:52 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:13:52 user nova-compute[75354]: </disk>
Nov 14 07:13:52 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated VIF entry in instance network info cache for port ae693970-fb3e-4a18-a8f5-245776cd5d9e. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.network.neutron [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:13:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0839e811-4b25-4768-8d86-e798d5fd5f11 req-058f4b0c-4f36-42d3-97d2-d2eeb00f4a34 service nova] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:13:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:13:53 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:13:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:03 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:08 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:14:08 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:14:10 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:14:10 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:14:10 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.105239868164062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:10 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance fb07d140-7b51-4db2-8acf-a034a38c9d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance da332860-2962-4c03-9c6c-416949017220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 05d00290-377f-47c1-baaa-a3bfb73f9150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:14:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb07d140-7b51-4db2-8acf-a034a38c9d9e is timed out.
Nov 14 07:14:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully detached device vdb from instance fb07d140-7b51-4db2-8acf-a034a38c9d9e from the live domain config.
Nov 14 07:14:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaDSRirp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:14:12 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3965e0c8-a5fd-42f2-b824-72f0b5fbf3c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:14:12 user nova-compute[75354]: No targets found.
Nov 14 07:14:12 user nova-compute[75354]: iSNS:
Nov 14 07:14:12 user nova-compute[75354]: No targets found.
Nov 14 07:14:12 user nova-compute[75354]: STATIC:
Nov 14 07:14:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a
Nov 14 07:14:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:14:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:14:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96
Nov 14 07:14:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:14:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:14:12 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12
Nov 14 07:14:12 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:14:12 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:14:12 user nova-compute[75354]: FIRMWARE:
Nov 14 07:14:12 user nova-compute[75354]: No targets found.
Nov 14 07:14:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:14:12 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:14:12 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97f968-b1dd-4c69-ac62-70b7c3e70945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ea270-1a7c-4935-ac2f-2bf73755ee36]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:14:12 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:14:12 user nova-compute[75354]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)
Nov 14 07:14:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:14:12 user nova-compute[75354]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 (non-flash)
Nov 14 07:14:12 user nova-compute[75354]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)
Nov 14 07:14:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80743ddcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12'): ({'sdd'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Removing single pathed devices sdd {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc009db2-322f-4397-aeef-8625a928c83b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[776a8c2a-ff0f-4cbe-ac12-e905da17f85d]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Flushing IO for device /dev/sdd {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c612d71c-0047-41a9-9aae-758283976f7c]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7da8d-bc60-48c2-a0bf-6a4a72e3735f]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] SCSI volumes sdd have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60180d92-682f-4e42-aaf4-b3e62d446130]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e859aec-bb14-4468-8022-f34448d14191]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260]
Nov 14 07:14:12 user nova-compute[75354]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12, portal: 172.16.0.220,3260] successful.
Nov 14 07:14:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4f9761d-7bbf-4b38-8ff9-5d14fd60cf12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[85055eba-2ba2-40f5-a56a-c0cb586acf03]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] <== disconnect_volume: return (301ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:14:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:14:13 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'flavor' on Instance uuid fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:14:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a6f4737f-a83b-40bc-bd1f-2981f9730968 tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.588s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:13 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [{"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-fb07d140-7b51-4db2-8acf-a034a38c9d9e" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:14:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:14:17 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:18 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:14:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:14:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:14:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:14:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:14:23 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:25 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:28 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:30 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:31 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:14:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:33 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:38 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:43 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:44 user nova-compute[75354]: INFO nova.compute.manager [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Terminating instance
Nov 14 07:14:44 user nova-compute[75354]: DEBUG nova.compute.manager [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-ad8bdcdb-1c0e-4560-b95b-2c5bac0e737f req-55ce69e8-46ee-4d72-96af-f6b332469833 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-unplugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ad8bdcdb-1c0e-4560-b95b-2c5bac0e737f req-55ce69e8-46ee-4d72-96af-f6b332469833 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ad8bdcdb-1c0e-4560-b95b-2c5bac0e737f req-55ce69e8-46ee-4d72-96af-f6b332469833 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ad8bdcdb-1c0e-4560-b95b-2c5bac0e737f req-55ce69e8-46ee-4d72-96af-f6b332469833 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-ad8bdcdb-1c0e-4560-b95b-2c5bac0e737f req-55ce69e8-46ee-4d72-96af-f6b332469833 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-unplugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:14:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-ad8bdcdb-1c0e-4560-b95b-2c5bac0e737f req-55ce69e8-46ee-4d72-96af-f6b332469833 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-unplugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:14:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Instance destroyed successfully.
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lazy-loading 'resources' on Instance uuid fb07d140-7b51-4db2-8acf-a034a38c9d9e {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1209714056',display_name='tempest-TestMinimumBasicScenario-server-1209714056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1209714056',id=50,image_ref='91ddbb6f-647f-467d-bcb3-b465356ff46e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrxz5+Bqfv6nzPc3EsG6U8sODQutLct4rYmZuA3naZ/+ss7wbaJGbkNqmq8dyXvncdXxsJY6Tfgbw1xYy1gahh/CEGcRDXgvMgt4NN0RwKPCa+52XLRFEdULtQt/zhLxw==',key_name='tempest-TestMinimumBasicScenario-1977450361',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:10:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bc12edce8444919eb156ebd6b2335d',ramdisk_id='',reservation_id='r-guc8tp82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='91ddbb6f-647f-467d-bcb3-b465356ff46e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1130383543',owner_user_name='tempest-TestMinimumBasicScenario-1130383543-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:12:07Z,user_data=None,user_id='0158f59d89724d6c8184fa2cf3c5f723',uuid=fb07d140-7b51-4db2-8acf-a034a38c9d9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converting VIF {"id": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "address": "fa:16:3e:cb:ac:0b", "network": {"id": "48a0d4e2-5953-4171-9b90-120f8dfe2a65", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1251498395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bc12edce8444919eb156ebd6b2335d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae693970-fb", "ovs_interfaceid": "ae693970-fb3e-4a18-a8f5-245776cd5d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG os_vif [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae693970-fb, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6870755-f1b1-4c79-abca-e1fa07208eff) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:14:45 user nova-compute[75354]: INFO os_vif [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ac:0b,bridge_name='br-int',has_traffic_filtering=True,id=ae693970-fb3e-4a18-a8f5-245776cd5d9e,network=Network(48a0d4e2-5953-4171-9b90-120f8dfe2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae693970-fb')
Nov 14 07:14:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Deleting instance files /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e_del
Nov 14 07:14:45 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Deletion of /opt/stack/data/nova/instances/fb07d140-7b51-4db2-8acf-a034a38c9d9e_del complete
Nov 14 07:14:45 user nova-compute[75354]: INFO nova.compute.manager [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 07:14:45 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:14:45 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Took 0.50 seconds to deallocate network for instance.
Nov 14 07:14:45 user nova-compute[75354]: DEBUG nova.compute.manager [req-443e5eb0-2653-4d57-a542-06dba6f6b406 req-4960f765-ca06-4e7d-93c8-a411093fe418 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-deleted-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:45 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:46 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Deleted allocations for instance fb07d140-7b51-4db2-8acf-a034a38c9d9e
Nov 14 07:14:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ba1944bd-1a09-4ab0-885e-112062cdfcbc tempest-TestMinimumBasicScenario-1130383543 tempest-TestMinimumBasicScenario-1130383543-project-member] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-bf5c3ab8-c859-41e7-9d35-719a25cd8806 req-c2d71f18-fabb-4bca-b531-48bea245e345 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bf5c3ab8-c859-41e7-9d35-719a25cd8806 req-c2d71f18-fabb-4bca-b531-48bea245e345 service nova] Acquiring lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bf5c3ab8-c859-41e7-9d35-719a25cd8806 req-c2d71f18-fabb-4bca-b531-48bea245e345 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-bf5c3ab8-c859-41e7-9d35-719a25cd8806 req-c2d71f18-fabb-4bca-b531-48bea245e345 service nova] Lock "fb07d140-7b51-4db2-8acf-a034a38c9d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:14:46 user nova-compute[75354]: DEBUG nova.compute.manager [req-bf5c3ab8-c859-41e7-9d35-719a25cd8806 req-c2d71f18-fabb-4bca-b531-48bea245e345 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] No waiting events found dispatching network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:14:46 user nova-compute[75354]: WARNING nova.compute.manager [req-bf5c3ab8-c859-41e7-9d35-719a25cd8806 req-c2d71f18-fabb-4bca-b531-48bea245e345 service nova] [instance: fb07d140-7b51-4db2-8acf-a034a38c9d9e] Received unexpected event network-vif-plugged-ae693970-fb3e-4a18-a8f5-245776cd5d9e for instance with vm_state deleted and task_state None.
Nov 14 07:14:50 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:14:55 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:15:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:15:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:15:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:15:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:15:00 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:15:07 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:08 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:09 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:09 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:15:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:10 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:15:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:15:11 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8871MB free_disk=25.131877899169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance da332860-2962-4c03-9c6c-416949017220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 05d00290-377f-47c1-baaa-a3bfb73f9150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:15:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:15 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:15:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-changed-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:15:15 user nova-compute[75354]: DEBUG nova.compute.manager [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Refreshing instance network info cache due to event network-changed-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:15:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] Acquiring lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:15:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] Acquired lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:15:15 user nova-compute[75354]: DEBUG nova.network.neutron [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Refreshing network info cache for port 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG nova.network.neutron [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updated VIF entry in instance network info cache for port 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG nova.network.neutron [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updating instance_info_cache with network_info: [{"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-c8508daa-3d12-45da-86fa-16d47ffbda33 req-e6ac93ba-0df8-482c-8c0e-a2c24fec21e6 service nova] Releasing lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:16 user nova-compute[75354]: INFO nova.compute.manager [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Terminating instance
Nov 14 07:15:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:15:16 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: da332860-2962-4c03-9c6c-416949017220] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-f6fb2121-8845-434a-9c88-86f50a8118bc req-a3da17c2-f076-4322-9032-7bdf6c1212b0 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-vif-unplugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f6fb2121-8845-434a-9c88-86f50a8118bc req-a3da17c2-f076-4322-9032-7bdf6c1212b0 service nova] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f6fb2121-8845-434a-9c88-86f50a8118bc req-a3da17c2-f076-4322-9032-7bdf6c1212b0 service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-f6fb2121-8845-434a-9c88-86f50a8118bc req-a3da17c2-f076-4322-9032-7bdf6c1212b0 service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-f6fb2121-8845-434a-9c88-86f50a8118bc req-a3da17c2-f076-4322-9032-7bdf6c1212b0 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] No waiting events found dispatching network-vif-unplugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-f6fb2121-8845-434a-9c88-86f50a8118bc req-a3da17c2-f076-4322-9032-7bdf6c1212b0 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-vif-unplugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: da332860-2962-4c03-9c6c-416949017220] Updating instance_info_cache with network_info: [{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: da332860-2962-4c03-9c6c-416949017220] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Instance destroyed successfully.
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.objects.instance [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'resources' on Instance uuid 05d00290-377f-47c1-baaa-a3bfb73f9150 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1560718656',display_name='tempest-TestVolumeBootPattern-server-1560718656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1560718656',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:13:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-jb4eo15e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:13:33Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=05d00290-377f-47c1-baaa-a3bfb73f9150,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_vif [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71b4f6cb-b2, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9861f8a6-dfd7-4149-a3b6-45716a3d397f) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-changed-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Refreshing instance network info cache due to event network-changed-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] Acquiring lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] Acquired lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.neutron [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Refreshing network info cache for port 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:15:17 user nova-compute[75354]: INFO os_vif [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c5:da,bridge_name='br-int',has_traffic_filtering=True,id=71b4f6cb-b23e-4947-8b4b-4c37bd53ee08,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b4f6cb-b2')
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHNqcpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:15:17 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d74bd3-9613-482e-90bb-6a467e8d902f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:15:17 user nova-compute[75354]: No targets found.
Nov 14 07:15:17 user nova-compute[75354]: iSNS:
Nov 14 07:15:17 user nova-compute[75354]: No targets found.
Nov 14 07:15:17 user nova-compute[75354]: STATIC:
Nov 14 07:15:17 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a
Nov 14 07:15:17 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:15:17 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:15:17 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96
Nov 14 07:15:17 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:15:17 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:15:17 user nova-compute[75354]: FIRMWARE:
Nov 14 07:15:17 user nova-compute[75354]: No targets found.
Nov 14 07:15:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:15:17 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:15:17 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f9fea4-f1ea-4a6e-ae05-de06ab616f9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a1b7c7-eb66-4450-a879-fc369659dcf8]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:15:17 user nova-compute[75354]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)
Nov 14 07:15:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:15:17 user nova-compute[75354]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a (non-flash)
Nov 14 07:15:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80741a3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a'): ({'sdc'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Removing single pathed devices sdc {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ce3c07-fb8b-44d9-9786-50c9385dd8b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3830bc4-30be-48a2-a7da-9defeb4542c3]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flushing IO for device /dev/sdc {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e9a21a-d9ca-4115-8c95-df6d9510e6e3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8642bc-1a5c-4f16-aac8-a913b9733aa3]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] SCSI volumes sdc have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_afdac9cd', '/dev/disk/by-id/scsi-1SCST_BIOafdac9cd-b66bfa70c23e1f59', '/dev/disk/by-id/scsi-26236366266613730') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 07:15:17 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_afdac9cd
Nov 14 07:15:17 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOafdac9cd-b66bfa70c23e1f59
Nov 14 07:15:17 user nova-compute[75354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26236366266613730
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f6a8f-d2c8-4fc1-87d6-bd324a0cca8e]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ba032-c8f2-44be-a1ed-4f1425de2feb]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eab016-f286-4bd2-8c00-d8ed604cad00]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260]
Nov 14 07:15:17 user nova-compute[75354]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a, portal: 172.16.0.220,3260] successful.
Nov 14 07:15:17 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4aa0013-67e9-46c0-af29-e3581ae0752a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a1956-6dab-4c93-b93f-0ff9308e3a2e]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== disconnect_volume: return (307ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:15:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Deleting instance files /opt/stack/data/nova/instances/05d00290-377f-47c1-baaa-a3bfb73f9150_del
Nov 14 07:15:17 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Deletion of /opt/stack/data/nova/instances/05d00290-377f-47c1-baaa-a3bfb73f9150_del complete
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.neutron [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updated VIF entry in instance network info cache for port 71b4f6cb-b23e-4947-8b4b-4c37bd53ee08. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.neutron [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updating instance_info_cache with network_info: [{"id": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "address": "fa:16:3e:40:c5:da", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b4f6cb-b2", "ovs_interfaceid": "71b4f6cb-b23e-4947-8b4b-4c37bd53ee08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:15:17 user nova-compute[75354]: INFO nova.compute.manager [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:15:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-68337223-2ac1-4227-9f3d-aa15645556b2 req-45ee018e-00f4-47c0-9d7d-7bebf9abd4ea service nova] Releasing lock "refresh_cache-05d00290-377f-47c1-baaa-a3bfb73f9150" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:15:18 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:15:18 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Took 0.47 seconds to deallocate network for instance.
Nov 14 07:15:19 user nova-compute[75354]: INFO nova.compute.manager [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-524e6633-5a5e-4fbd-8a7d-dc6971c17096 req-68a0f42a-ff55-4672-bfe9-5644579e513d service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-524e6633-5a5e-4fbd-8a7d-dc6971c17096 req-68a0f42a-ff55-4672-bfe9-5644579e513d service nova] Acquiring lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-524e6633-5a5e-4fbd-8a7d-dc6971c17096 req-68a0f42a-ff55-4672-bfe9-5644579e513d service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-524e6633-5a5e-4fbd-8a7d-dc6971c17096 req-68a0f42a-ff55-4672-bfe9-5644579e513d service nova] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-524e6633-5a5e-4fbd-8a7d-dc6971c17096 req-68a0f42a-ff55-4672-bfe9-5644579e513d service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] No waiting events found dispatching network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:15:19 user nova-compute[75354]: WARNING nova.compute.manager [req-524e6633-5a5e-4fbd-8a7d-dc6971c17096 req-68a0f42a-ff55-4672-bfe9-5644579e513d service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received unexpected event network-vif-plugged-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 for instance with vm_state deleted and task_state None.
Nov 14 07:15:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:19 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Deleted allocations for instance 05d00290-377f-47c1-baaa-a3bfb73f9150
Nov 14 07:15:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-a3954617-cdb2-4c4a-94a6-7772ce89ac83 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "05d00290-377f-47c1-baaa-a3bfb73f9150" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.630s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:19 user nova-compute[75354]: DEBUG nova.compute.manager [req-c425285b-a93e-47ed-9405-dad6c7c476cb req-060df793-bb6d-4157-8b6c-325e82cfaa84 service nova] [instance: 05d00290-377f-47c1-baaa-a3bfb73f9150] Received event network-vif-deleted-71b4f6cb-b23e-4947-8b4b-4c37bd53ee08 {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:15:22 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:27 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:15:27 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:15:32 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:35 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:42 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:52 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:15:57 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:09 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-changed-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Refreshing instance network info cache due to event network-changed-f5bd5c51-6645-4df0-9446-044dc73e6afe. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] Acquiring lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] Acquired lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Refreshing network info cache for port f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "da332860-2962-4c03-9c6c-416949017220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "da332860-2962-4c03-9c6c-416949017220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "da332860-2962-4c03-9c6c-416949017220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "da332860-2962-4c03-9c6c-416949017220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "da332860-2962-4c03-9c6c-416949017220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:11 user nova-compute[75354]: INFO nova.compute.manager [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Terminating instance
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-abacb3e1-8fcb-4159-8966-abbebe050b17 req-e8f9964e-65f2-4dd7-9265-b8e0034d0834 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-vif-unplugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-abacb3e1-8fcb-4159-8966-abbebe050b17 req-e8f9964e-65f2-4dd7-9265-b8e0034d0834 service nova] Acquiring lock "da332860-2962-4c03-9c6c-416949017220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-abacb3e1-8fcb-4159-8966-abbebe050b17 req-e8f9964e-65f2-4dd7-9265-b8e0034d0834 service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-abacb3e1-8fcb-4159-8966-abbebe050b17 req-e8f9964e-65f2-4dd7-9265-b8e0034d0834 service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-abacb3e1-8fcb-4159-8966-abbebe050b17 req-e8f9964e-65f2-4dd7-9265-b8e0034d0834 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] No waiting events found dispatching network-vif-unplugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.compute.manager [req-abacb3e1-8fcb-4159-8966-abbebe050b17 req-e8f9964e-65f2-4dd7-9265-b8e0034d0834 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-vif-unplugged-f5bd5c51-6645-4df0-9446-044dc73e6afe for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Updated VIF entry in instance network info cache for port f5bd5c51-6645-4df0-9446-044dc73e6afe. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.network.neutron [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Updating instance_info_cache with network_info: [{"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-7fe70331-dcd8-4982-8978-c7fcea731f67 req-27db625f-637b-4c34-b84f-0952ed85edc4 service nova] Releasing lock "refresh_cache-da332860-2962-4c03-9c6c-416949017220" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:16:11 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: da332860-2962-4c03-9c6c-416949017220] Instance destroyed successfully.
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.objects.instance [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lazy-loading 'resources' on Instance uuid da332860-2962-4c03-9c6c-416949017220 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-208674996',display_name='tempest-TestVolumeBootPattern-server-208674996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-208674996',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQnVnk3btcbhn2oXz3VcZ0n7PXsInaymYruIjZ/9LUjlP0RPyaKvKozZ70OfxmxJ0oVNmx1FKusrhVtU/76L7OCEacCH04oA3IZfgQGZ9N7CTxZHSBK6kzlIpKAeJs9vQ==',key_name='tempest-TestVolumeBootPattern-1053948159',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9131ea3f6241aead77fcf82f1e8000',ramdisk_id='',reservation_id='r-po4xweqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643565198',owner_user_name='tempest-TestVolumeBootPattern-1643565198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:11:37Z,user_data=None,user_id='31f9b73f37fb4801aa39ff23e1a095cc',uuid=da332860-2962-4c03-9c6c-416949017220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converting VIF {"id": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "address": "fa:16:3e:74:ef:37", "network": {"id": "138c1da0-653b-44fd-8422-871cc7406ea9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1655577689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9131ea3f6241aead77fcf82f1e8000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5bd5c51-66", "ovs_interfaceid": "f5bd5c51-6645-4df0-9446-044dc73e6afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_vif [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5bd5c51-66, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ac062ca-23aa-4ae8-b702-94e65199856a) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:11 user nova-compute[75354]: INFO os_vif [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ef:37,bridge_name='br-int',has_traffic_filtering=True,id=f5bd5c51-6645-4df0-9446-044dc73e6afe,network=Network(138c1da0-653b-44fd-8422-871cc7406ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5bd5c51-66')
Nov 14 07:16:11 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUlSePH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:16:11 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a78c3-c185-439a-ba30-efa835452cf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:16:11 user nova-compute[75354]: No targets found.
Nov 14 07:16:11 user nova-compute[75354]: iSNS:
Nov 14 07:16:11 user nova-compute[75354]: No targets found.
Nov 14 07:16:11 user nova-compute[75354]: STATIC:
Nov 14 07:16:11 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96
Nov 14 07:16:11 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:16:11 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:16:11 user nova-compute[75354]: FIRMWARE:
Nov 14 07:16:11 user nova-compute[75354]: No targets found.
Nov 14 07:16:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:16:11 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:16:11 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706fd48-e208-4817-8951-701e707a46ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0a2752-2ec7-47c4-bd7c-b959b39c6f58]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:16:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 (non-flash)
Nov 14 07:16:11 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80744572e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:16:11 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[35329c8a-d36d-45a8-8ffb-a6fc66e0b522]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd5a86e-be3c-44eb-8212-366161e0931a]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac6ebf9-a908-4491-a471-79fcfd4ff262]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e749873-bbb9-4554-8f84-252a7ba45f0e]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO16540fd2-c7c9ad9260f8462a', '/dev/disk/by-id/scsi-26337633961643932', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_16540fd2') {{(pid=85546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe8193-a47f-44ec-b928-c33b91690a8c]: (4, None) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e324474-6089-423f-8ac8-588c75559335]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62f7e09-2c35-4403-bf0d-7d73f75fa427]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260]
Nov 14 07:16:12 user nova-compute[75354]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96, portal: 172.16.0.220,3260] successful.
Nov 14 07:16:12 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07ee897-3f9d-4193-a9cb-d4f8338dec96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e42c4-e7f0-459b-a09e-aee6b35229c0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] <== disconnect_volume: return (285ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:16:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Deleting instance files /opt/stack/data/nova/instances/da332860-2962-4c03-9c6c-416949017220_del
Nov 14 07:16:12 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Deletion of /opt/stack/data/nova/instances/da332860-2962-4c03-9c6c-416949017220_del complete
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 07:16:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:16:12 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=25.17021942138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:12 user nova-compute[75354]: INFO nova.compute.manager [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: da332860-2962-4c03-9c6c-416949017220] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: da332860-2962-4c03-9c6c-416949017220] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance da332860-2962-4c03-9c6c-416949017220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:16:12 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: da332860-2962-4c03-9c6c-416949017220] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:16:13 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: da332860-2962-4c03-9c6c-416949017220] Took 0.41 seconds to deallocate network for instance.
Nov 14 07:16:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-bc0ed472-3c9d-47f4-91d3-25c69aa4f168 req-1f3ec2b1-0d55-4b67-848e-d7a38e5fbc20 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-vif-deleted-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-fe821ac7-c98b-464e-8b1d-34ce6b7b7018 req-60f6d90f-61e6-48dd-9277-02b4bf395610 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received event network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fe821ac7-c98b-464e-8b1d-34ce6b7b7018 req-60f6d90f-61e6-48dd-9277-02b4bf395610 service nova] Acquiring lock "da332860-2962-4c03-9c6c-416949017220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fe821ac7-c98b-464e-8b1d-34ce6b7b7018 req-60f6d90f-61e6-48dd-9277-02b4bf395610 service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-fe821ac7-c98b-464e-8b1d-34ce6b7b7018 req-60f6d90f-61e6-48dd-9277-02b4bf395610 service nova] Lock "da332860-2962-4c03-9c6c-416949017220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG nova.compute.manager [req-fe821ac7-c98b-464e-8b1d-34ce6b7b7018 req-60f6d90f-61e6-48dd-9277-02b4bf395610 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] No waiting events found dispatching network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:16:13 user nova-compute[75354]: WARNING nova.compute.manager [req-fe821ac7-c98b-464e-8b1d-34ce6b7b7018 req-60f6d90f-61e6-48dd-9277-02b4bf395610 service nova] [instance: da332860-2962-4c03-9c6c-416949017220] Received unexpected event network-vif-plugged-f5bd5c51-6645-4df0-9446-044dc73e6afe for instance with vm_state active and task_state deleting.
Nov 14 07:16:13 user nova-compute[75354]: INFO nova.compute.manager [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] [instance: da332860-2962-4c03-9c6c-416949017220] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:13 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Deleted allocations for instance da332860-2962-4c03-9c6c-416949017220
Nov 14 07:16:13 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-c1ad2a91-4797-4aa3-aa2b-95c712c9a821 tempest-TestVolumeBootPattern-1643565198 tempest-TestVolumeBootPattern-1643565198-project-member] Lock "da332860-2962-4c03-9c6c-416949017220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.840s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:16:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:16:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:16:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:29 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:32 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 07:16:36 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 07:16:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:41 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:16:41 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 07:16:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:16:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:16:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:16:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:16:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:16:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:17:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:17:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:17:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:17:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:07 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:09 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:11 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:12 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:17:14 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:17:14 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9298MB free_disk=25.169021606445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:17:14 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:17:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:17:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:17:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:17:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:17:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:17:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:17:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:30 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:17:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:37 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:39 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:40 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:47 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Starting instance... {{(pid=75354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 07:17:53 user nova-compute[75354]: INFO nova.compute.claims [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Claim successful on node user
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Start building networks asynchronously for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Allocating IP information in the background. {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] allocate_for_instance() {{(pid=75354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 07:17:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Start building block device mappings for instance. {{(pid=75354) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.policy [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16dc2b0e91db449b9c5bb501cf3a4a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77534a98c50e409b88f1cdbaaecd7614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75354) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Start spawning the instance on the hypervisor. {{(pid=75354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Creating instance directory {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 07:17:53 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Creating image(s)
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "/opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "/opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "/opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.196s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "61315e85d573e872f3040842d6734eb71ee68e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk 1073741824 {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10,backing_fmt=raw /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk 1073741824" returned: 0 in 0.070s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "61315e85d573e872f3040842d6734eb71ee68e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61315e85d573e872f3040842d6734eb71ee68e10 --force-share --output=json" returned: 0 in 0.178s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk. size=1073741824 {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Successfully created port: 944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG nova.virt.disk.api [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Cannot resize image /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk to a smaller size. {{(pid=75354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Created local disks {{(pid=75354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Ensure instance console log exists: /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/console.log {{(pid=75354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Successfully updated port: 944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 07:17:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:17:55 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:17:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Building network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 07:17:55 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Instance cache missing network info. {{(pid=75354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-changed-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.compute.manager [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Refreshing instance network info cache due to event network-changed-944b529c-2b71-46a9-a39e-6cb737f5fbdd. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.neutron [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Instance network_info: |[{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Refreshing network info cache for port 944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Start _get_guest_xml network_info=[{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '013c3665-3f76-488b-92b6-f08787e9badf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 07:17:56 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:17:56 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CPU controller missing on host. {{(pid=75354) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.host [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CPU controller found on host. {{(pid=75354) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T06:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T06:25:54Z,direct_url=<?>,disk_format='qcow2',id=013c3665-3f76-488b-92b6-f08787e9badf,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0604d082fcb34afb9cdff24891cd3fd9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T06:25:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Flavor limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Image limits 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Flavor pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Image pref 0:0:0 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Got 1 possible topologies {{(pid=75354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.hardware [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1464801913',display_name='tempest-SnapshotDataIntegrityTests-server-1464801913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1464801913',id=53,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+wZOsDiAGHFfV/dr2zxA6VFinUVvL2Fchd1pCX8HPcQvrhVcqKs3gOWh7Z1zzZARGIH1xh9Nh7STKKhfmI0YzLZfJM3dViEmMMmLp1pnPjs51+TfrCzDxXZdWN8VRDEw==',key_name='tempest-keypair-1700690887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77534a98c50e409b88f1cdbaaecd7614',ramdisk_id='',reservation_id='r-t9wjase3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1851336300',owner_user_name='tempest-SnapshotDataIntegrityTests-1851336300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16dc2b0e91db449b9c5bb501cf3a4a3f',uuid=40daef10-7ed8-49cf-b407-01a7c1596317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Converting VIF {"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.objects.instance [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'pci_devices' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] End _get_guest_xml xml=<domain type="kvm">
Nov 14 07:17:56 user nova-compute[75354]:   <uuid>40daef10-7ed8-49cf-b407-01a7c1596317</uuid>
Nov 14 07:17:56 user nova-compute[75354]:   <name>instance-00000035</name>
Nov 14 07:17:56 user nova-compute[75354]:   <memory>524288</memory>
Nov 14 07:17:56 user nova-compute[75354]:   <vcpu>1</vcpu>
Nov 14 07:17:56 user nova-compute[75354]:   <metadata>
Nov 14 07:17:56 user nova-compute[75354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 07:17:56 user nova-compute[75354]:       <nova:package version="0.0.0"/>
Nov 14 07:17:56 user nova-compute[75354]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1464801913</nova:name>
Nov 14 07:17:56 user nova-compute[75354]:       <nova:creationTime>2023-11-14 07:17:56</nova:creationTime>
Nov 14 07:17:56 user nova-compute[75354]:       <nova:flavor name="m1.tiny">
Nov 14 07:17:56 user nova-compute[75354]:         <nova:memory>512</nova:memory>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:disk>1</nova:disk>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:swap>0</nova:swap>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:vcpus>1</nova:vcpus>
Nov 14 07:17:56 user nova-compute[75354]:       </nova:flavor>
Nov 14 07:17:56 user nova-compute[75354]:       <nova:owner>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:user uuid="16dc2b0e91db449b9c5bb501cf3a4a3f">tempest-SnapshotDataIntegrityTests-1851336300-project-member</nova:user>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:project uuid="77534a98c50e409b88f1cdbaaecd7614">tempest-SnapshotDataIntegrityTests-1851336300</nova:project>
Nov 14 07:17:56 user nova-compute[75354]:       </nova:owner>
Nov 14 07:17:56 user nova-compute[75354]:       <nova:root type="image" uuid="013c3665-3f76-488b-92b6-f08787e9badf"/>
Nov 14 07:17:56 user nova-compute[75354]:       <nova:ports>
Nov 14 07:17:56 user nova-compute[75354]:         <nova:port uuid="944b529c-2b71-46a9-a39e-6cb737f5fbdd">
Nov 14 07:17:56 user nova-compute[75354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 07:17:56 user nova-compute[75354]:         </nova:port>
Nov 14 07:17:56 user nova-compute[75354]:       </nova:ports>
Nov 14 07:17:56 user nova-compute[75354]:     </nova:instance>
Nov 14 07:17:56 user nova-compute[75354]:   </metadata>
Nov 14 07:17:56 user nova-compute[75354]:   <sysinfo type="smbios">
Nov 14 07:17:56 user nova-compute[75354]:     <system>
Nov 14 07:17:56 user nova-compute[75354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 07:17:56 user nova-compute[75354]:       <entry name="product">OpenStack Nova</entry>
Nov 14 07:17:56 user nova-compute[75354]:       <entry name="version">0.0.0</entry>
Nov 14 07:17:56 user nova-compute[75354]:       <entry name="serial">40daef10-7ed8-49cf-b407-01a7c1596317</entry>
Nov 14 07:17:56 user nova-compute[75354]:       <entry name="uuid">40daef10-7ed8-49cf-b407-01a7c1596317</entry>
Nov 14 07:17:56 user nova-compute[75354]:       <entry name="family">Virtual Machine</entry>
Nov 14 07:17:56 user nova-compute[75354]:     </system>
Nov 14 07:17:56 user nova-compute[75354]:   </sysinfo>
Nov 14 07:17:56 user nova-compute[75354]:   <os>
Nov 14 07:17:56 user nova-compute[75354]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 07:17:56 user nova-compute[75354]:     <boot dev="hd"/>
Nov 14 07:17:56 user nova-compute[75354]:     <smbios mode="sysinfo"/>
Nov 14 07:17:56 user nova-compute[75354]:   </os>
Nov 14 07:17:56 user nova-compute[75354]:   <features>
Nov 14 07:17:56 user nova-compute[75354]:     <acpi/>
Nov 14 07:17:56 user nova-compute[75354]:     <apic/>
Nov 14 07:17:56 user nova-compute[75354]:     <vmcoreinfo/>
Nov 14 07:17:56 user nova-compute[75354]:   </features>
Nov 14 07:17:56 user nova-compute[75354]:   <clock offset="utc">
Nov 14 07:17:56 user nova-compute[75354]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 07:17:56 user nova-compute[75354]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 07:17:56 user nova-compute[75354]:     <timer name="hpet" present="no"/>
Nov 14 07:17:56 user nova-compute[75354]:   </clock>
Nov 14 07:17:56 user nova-compute[75354]:   <cpu mode="custom" match="exact">
Nov 14 07:17:56 user nova-compute[75354]:     <model>Nehalem</model>
Nov 14 07:17:56 user nova-compute[75354]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 07:17:56 user nova-compute[75354]:   </cpu>
Nov 14 07:17:56 user nova-compute[75354]:   <devices>
Nov 14 07:17:56 user nova-compute[75354]:     <disk type="file" device="disk">
Nov 14 07:17:56 user nova-compute[75354]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 07:17:56 user nova-compute[75354]:       <source file="/opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk"/>
Nov 14 07:17:56 user nova-compute[75354]:       <target dev="vda" bus="virtio"/>
Nov 14 07:17:56 user nova-compute[75354]:     </disk>
Nov 14 07:17:56 user nova-compute[75354]:     <interface type="ethernet">
Nov 14 07:17:56 user nova-compute[75354]:       <mac address="fa:16:3e:23:70:78"/>
Nov 14 07:17:56 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:17:56 user nova-compute[75354]:       <mtu size="1442"/>
Nov 14 07:17:56 user nova-compute[75354]:       <target dev="tap944b529c-2b"/>
Nov 14 07:17:56 user nova-compute[75354]:     </interface>
Nov 14 07:17:56 user nova-compute[75354]:     <serial type="pty">
Nov 14 07:17:56 user nova-compute[75354]:       <log file="/opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/console.log" append="off"/>
Nov 14 07:17:56 user nova-compute[75354]:     </serial>
Nov 14 07:17:56 user nova-compute[75354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 07:17:56 user nova-compute[75354]:     <video>
Nov 14 07:17:56 user nova-compute[75354]:       <model type="virtio"/>
Nov 14 07:17:56 user nova-compute[75354]:     </video>
Nov 14 07:17:56 user nova-compute[75354]:     <rng model="virtio">
Nov 14 07:17:56 user nova-compute[75354]:       <backend model="random">/dev/urandom</backend>
Nov 14 07:17:56 user nova-compute[75354]:     </rng>
Nov 14 07:17:56 user nova-compute[75354]:     <controller type="usb" index="0" model="none"/>
Nov 14 07:17:56 user nova-compute[75354]:     <memballoon model="virtio">
Nov 14 07:17:56 user nova-compute[75354]:       <stats period="10"/>
Nov 14 07:17:56 user nova-compute[75354]:     </memballoon>
Nov 14 07:17:56 user nova-compute[75354]:   </devices>
Nov 14 07:17:56 user nova-compute[75354]: </domain>
Nov 14 07:17:56 user nova-compute[75354]:  {{(pid=75354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1464801913',display_name='tempest-SnapshotDataIntegrityTests-server-1464801913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1464801913',id=53,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+wZOsDiAGHFfV/dr2zxA6VFinUVvL2Fchd1pCX8HPcQvrhVcqKs3gOWh7Z1zzZARGIH1xh9Nh7STKKhfmI0YzLZfJM3dViEmMMmLp1pnPjs51+TfrCzDxXZdWN8VRDEw==',key_name='tempest-keypair-1700690887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77534a98c50e409b88f1cdbaaecd7614',ramdisk_id='',reservation_id='r-t9wjase3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1851336300',owner_user_name='tempest-SnapshotDataIntegrityTests-1851336300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T07:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16dc2b0e91db449b9c5bb501cf3a4a3f',uuid=40daef10-7ed8-49cf-b407-01a7c1596317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Converting VIF {"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG os_vif [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b') {{(pid=75354) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d94caa4-e2b6-5d1f-81ca-c7c9711c1cfe', '_type': 'linux-noop'}}, row=False) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap944b529c-2b, may_exist=True, interface_attrs={}) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap944b529c-2b, col_values=(('qos', UUID('420f646e-059c-4a56-9b8b-31a5dbc3aa7f')),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap944b529c-2b, col_values=(('external_ids', {'iface-id': '944b529c-2b71-46a9-a39e-6cb737f5fbdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:70:78', 'vm-uuid': '40daef10-7ed8-49cf-b407-01a7c1596317'}),), if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:56 user nova-compute[75354]: INFO os_vif [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b')
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No VIF found with MAC fa:16:3e:23:70:78, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated VIF entry in instance network info cache for port 944b529c-2b71-46a9-a39e-6cb737f5fbdd. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG nova.network.neutron [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:17:56 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-472826ef-3694-4241-8c29-760a5a2b6ec8 req-3e09a160-4b7b-429e-9195-56a0b1452dc9 service nova] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-667bc0bd-e0b1-4860-adb0-e7edc82d5d21 req-f28a1049-5fa0-440f-be3c-7ccb404deecb service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-667bc0bd-e0b1-4860-adb0-e7edc82d5d21 req-f28a1049-5fa0-440f-be3c-7ccb404deecb service nova] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-667bc0bd-e0b1-4860-adb0-e7edc82d5d21 req-f28a1049-5fa0-440f-be3c-7ccb404deecb service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-667bc0bd-e0b1-4860-adb0-e7edc82d5d21 req-f28a1049-5fa0-440f-be3c-7ccb404deecb service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG nova.compute.manager [req-667bc0bd-e0b1-4860-adb0-e7edc82d5d21 req-f28a1049-5fa0-440f-be3c-7ccb404deecb service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] No waiting events found dispatching network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:17:58 user nova-compute[75354]: WARNING nova.compute.manager [req-667bc0bd-e0b1-4860-adb0-e7edc82d5d21 req-f28a1049-5fa0-440f-be3c-7ccb404deecb service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received unexpected event network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd for instance with vm_state building and task_state spawning.
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:58 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:17:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-0893f850-a9de-449d-b064-c17ceccb7040 req-16832e74-eeb3-43c3-9227-4a3535efdc02 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0893f850-a9de-449d-b064-c17ceccb7040 req-16832e74-eeb3-43c3-9227-4a3535efdc02 service nova] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0893f850-a9de-449d-b064-c17ceccb7040 req-16832e74-eeb3-43c3-9227-4a3535efdc02 service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0893f850-a9de-449d-b064-c17ceccb7040 req-16832e74-eeb3-43c3-9227-4a3535efdc02 service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.compute.manager [req-0893f850-a9de-449d-b064-c17ceccb7040 req-16832e74-eeb3-43c3-9227-4a3535efdc02 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] No waiting events found dispatching network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:18:00 user nova-compute[75354]: WARNING nova.compute.manager [req-0893f850-a9de-449d-b064-c17ceccb7040 req-16832e74-eeb3-43c3-9227-4a3535efdc02 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received unexpected event network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd for instance with vm_state building and task_state spawning.
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Instance event wait completed in 0 seconds for  {{(pid=75354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Guest created on hypervisor {{(pid=75354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 07:18:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Instance spawned successfully.
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Found default for hw_cdrom_bus of ide {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Found default for hw_disk_bus of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Found default for hw_input_bus of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Found default for hw_pointer_model of None {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Found default for hw_video_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Found default for hw_vif_model of virtio {{(pid=75354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 07:18:00 user nova-compute[75354]: INFO nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 14 07:18:00 user nova-compute[75354]: DEBUG nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Checking state {{(pid=75354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 07:18:00 user nova-compute[75354]: INFO nova.compute.manager [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Took 7.63 seconds to build instance.
Nov 14 07:18:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-1c01254e-4cbe-4c3a-b2b8-3b0709805361 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.744s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:18:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:09 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:10 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:18:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:18:15 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:18:15 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:18:15 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.126731872558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:18:15 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 40daef10-7ed8-49cf-b407-01a7c1596317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:18:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:18:19 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:18:20 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:18:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:24 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:29 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:32 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:32 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:18:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:18:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:18:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:18:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:18:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:18:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:18:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:18:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:12 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:13 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:19:14 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:16 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:19:17 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.12432098388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 40daef10-7ed8-49cf-b407-01a7c1596317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:19:17 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:19:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:19:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:19:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:19:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:19:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:19:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:19:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:19:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-changed-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG nova.compute.manager [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Refreshing instance network info cache due to event network-changed-944b529c-2b71-46a9-a39e-6cb737f5fbdd. {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Refreshing network info cache for port 944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated VIF entry in instance network info cache for port 944b529c-2b71-46a9-a39e-6cb737f5fbdd. {{(pid=75354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG nova.network.neutron [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:19:44 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-96e359dc-30dd-4905-ac3c-a7439bf66ba4 req-8d031d65-7fd4-4fd1-9656-1e1fbb6ede0a service nova] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG nova.objects.instance [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:19:46 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:19:46 user nova-compute[75354]: INFO nova.compute.manager [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attaching volume 099b830e-524b-4583-8b6f-27d30e4b3635 to /dev/vdb
Nov 14 07:19:47 user nova-compute[75354]: DEBUG os_brick.utils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f85fb-ac1d-438c-85cf-f5dcfed34490]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d07020-69f6-430e-8734-156250a2e38d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b781909-06d7-438f-9306-a2052b9a4aed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69159c-96d4-4041-ad83-9d2fcb091ed8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:19:47 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:19:47 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cdc9a0-29ac-4fbb-b89d-a499ef97f1ee]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG os_brick.utils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:19:47 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating existing volume attachment record: 31dee048-a00b-4bd7-a834-653754f748d1 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:19:49 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpjKiUPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:19:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:19:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:19:51 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb01030-9b16-47c1-a4cf-c0962e192d24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:19:51 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc89605-789a-4d90-89d5-77368bb30314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635] added
Nov 14 07:19:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f221322-455e-460c-8563-2a08af41c604]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f309b974-5229-493e-b38d-1046241570d3]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpjKiUPW {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpjKiUPW" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1950e22-6783-4f2d-ae48-89575126c5e6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpjKiUPW'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7a0487-d74a-4d75-a9c9-f3e0e65c0240]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d1a468-1e39-4901-be17-6a424a5fe9e6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:19:51 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:19:51 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:19:51 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:19:51 user nova-compute[75354]: 
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a1a8f-8393-43f5-848a-8ac17cabcb2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260]
Nov 14 07:19:51 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260] successful.
Nov 14 07:19:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c72c3e-feef-4791-8fa8-073284161402]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bdc3b4-559e-4589-ad25-e905e7cfb6a5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 (non-flash)
Nov 14 07:19:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 (non-flash)
Nov 14 07:19:51 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a551cd6-be74-42dd-9622-d54aac2c373f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:19:51 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpjKiUPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:19:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:19:52 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23337383465666232', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:19:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337383465666232', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:19:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:19:52 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:19:52 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:19:52 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:19:52 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:19:52 user nova-compute[75354]:   <serial>099b830e-524b-4583-8b6f-27d30e4b3635</serial>
Nov 14 07:19:52 user nova-compute[75354]: </disk>
Nov 14 07:19:52 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:19:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:19:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:19:53 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No VIF found with MAC fa:16:3e:23:70:78, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:19:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-19e88da8-b878-4529-8d5e-b523b78eba8c tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.213s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:19:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:19:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:20:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:20:00 user nova-compute[75354]: INFO nova.compute.manager [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Detaching volume 099b830e-524b-4583-8b6f-27d30e4b3635
Nov 14 07:20:00 user nova-compute[75354]: INFO nova.virt.block_device [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attempting to driver detach volume 099b830e-524b-4583-8b6f-27d30e4b3635 from mountpoint /dev/vdb
Nov 14 07:20:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Attempting to detach device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:20:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:20:00 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:20:00 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:20:00 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:20:00 user nova-compute[75354]:   <serial>099b830e-524b-4583-8b6f-27d30e4b3635</serial>
Nov 14 07:20:00 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:20:00 user nova-compute[75354]: </disk>
Nov 14 07:20:00 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:20:00 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config.
Nov 14 07:20:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:20:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:20:00 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:20:00 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:20:00 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:20:00 user nova-compute[75354]:   <serial>099b830e-524b-4583-8b6f-27d30e4b3635</serial>
Nov 14 07:20:00 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:20:00 user nova-compute[75354]: </disk>
Nov 14 07:20:00 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:20:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:20:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:20:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:20:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:20:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:20:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.12303924560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 40daef10-7ed8-49cf-b407-01a7c1596317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:20:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:20:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:20:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:20:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:20:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:20:19 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 is timed out.
Nov 14 07:20:20 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config.
Nov 14 07:20:20 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:20:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpjKiUPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:20:20 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:20:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:20:20 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:20:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:20 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e162576-92e2-48d2-b4f6-9068de02e443]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:20:21 user nova-compute[75354]: No targets found.
Nov 14 07:20:21 user nova-compute[75354]: iSNS:
Nov 14 07:20:21 user nova-compute[75354]: No targets found.
Nov 14 07:20:21 user nova-compute[75354]: STATIC:
Nov 14 07:20:21 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635
Nov 14 07:20:21 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:20:21 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:20:21 user nova-compute[75354]: FIRMWARE:
Nov 14 07:20:21 user nova-compute[75354]: No targets found.
Nov 14 07:20:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:20:21 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:20:21 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e46b1-89f0-4e3e-83c9-5a9a065ef85b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d57459-e551-47a7-b8c4-a76850d3272f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 (non-flash)
Nov 14 07:20:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 (non-flash)
Nov 14 07:20:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809449bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5152c7-151f-4005-a007-c7c830ce5b2f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa3a6b2-0d93-4749-8ac9-659aa9f7dd53]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a97b0-a33c-4156-b527-4ec9d44b860f]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2e894b-3ec5-4cfa-bba4-fe90344be3e4]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9ad83-29d0-49c9-8758-7fc697671f59]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee606a-7465-4c72-80bf-4ff36fec9a80]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260]
Nov 14 07:20:21 user nova-compute[75354]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635, portal: 172.16.0.220,3260] successful.
Nov 14 07:20:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099b830e-524b-4583-8b6f-27d30e4b3635 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c852a1e5-1a7c-4571-baa1-ac778e8261ba]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== disconnect_volume: return (322ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:20:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.objects.instance [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4d532a86-febd-43a8-bc0c-7b3d2f439eee tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:20:22 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:20:33 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:20:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:20:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:20:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:20:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:20:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:20:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:20:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:20:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:20:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:20:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:20:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:20:52 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:20:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:20:53 user nova-compute[75354]: INFO nova.compute.manager [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attaching volume 9ba4e124-8267-4a07-acd1-5eece253eeab to /dev/vdb
Nov 14 07:20:53 user nova-compute[75354]: DEBUG os_brick.utils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7530c2-5f98-45b4-9c70-cddaf985d0b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c4faa-01b4-4ec4-a466-8b814b092d62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68596023-f0ba-4064-a490-f328331f4f62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a6635-b779-47c6-ae41-156929555a5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:20:53 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:20:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced6222-5731-42c3-a1b9-00d77aeedc10]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG os_brick.utils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:20:53 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating existing volume attachment record: 29414871-1fba-48a0-a0af-3b7c5bcf12b8 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:20:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tzChBDvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:20:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:20:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:20:57 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bcb085-3349-4976-b6e6-1d216a192015]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:20:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf766e6-4793-4358-9f79-0c7c25340987]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab] added
Nov 14 07:20:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afee2c-f019-48cb-9636-74ed50195643]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9015be40-74bb-48ad-aceb-30f019821f27]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tzChBDvV {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tzChBDvV" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9328fd1c-0d98-4c4d-8240-e0377c93bb50]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tzChBDvV'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b90f2-53f5-4765-97e4-350a8c8d2bc2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4131453b-c77b-4afc-a402-cedc29c96619]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:20:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:20:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:20:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:20:57 user nova-compute[75354]: 
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93845145-41c4-4864-b6b7-2fcc50aa1ebe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260]
Nov 14 07:20:57 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260] successful.
Nov 14 07:20:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72af04f-8ea8-462b-8c1b-aa8e0e141dd2]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca213a-00ad-4f19-b1c3-c31369f84ee0]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab (non-flash)
Nov 14 07:20:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab (non-flash)
Nov 14 07:20:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbd7abd-3740-4f8d-9837-28f15a209b6f]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:20:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tzChBDvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:20:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:20:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23261643535343339', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:20:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261643535343339', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:20:58 user nova-compute[75354]: DEBUG nova.objects.instance [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:20:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:20:58 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:20:58 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:20:58 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:20:58 user nova-compute[75354]:   <serial>9ba4e124-8267-4a07-acd1-5eece253eeab</serial>
Nov 14 07:20:58 user nova-compute[75354]: </disk>
Nov 14 07:20:58 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:20:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:20:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:20:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No VIF found with MAC fa:16:3e:23:70:78, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:20:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-ccb8839b-c26b-429d-920d-402bcf033d33 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.085s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:20:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:21:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:21:01 user nova-compute[75354]: INFO nova.compute.manager [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Detaching volume 9ba4e124-8267-4a07-acd1-5eece253eeab
Nov 14 07:21:01 user nova-compute[75354]: INFO nova.virt.block_device [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attempting to driver detach volume 9ba4e124-8267-4a07-acd1-5eece253eeab from mountpoint /dev/vdb
Nov 14 07:21:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Attempting to detach device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:21:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:21:01 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:21:01 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:21:01 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:21:01 user nova-compute[75354]:   <serial>9ba4e124-8267-4a07-acd1-5eece253eeab</serial>
Nov 14 07:21:01 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:21:01 user nova-compute[75354]: </disk>
Nov 14 07:21:01 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:21:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config.
Nov 14 07:21:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:21:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:21:01 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:21:01 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:21:01 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:21:01 user nova-compute[75354]:   <serial>9ba4e124-8267-4a07-acd1-5eece253eeab</serial>
Nov 14 07:21:01 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:21:01 user nova-compute[75354]: </disk>
Nov 14 07:21:01 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:21:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:21:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:13 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:15 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:21:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:21:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.12213134765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:21:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 40daef10-7ed8-49cf-b407-01a7c1596317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:21:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:21 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 is timed out.
Nov 14 07:21:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config.
Nov 14 07:21:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tzChBDvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:21:21 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3b89c-84c9-4fd1-9deb-0f9efbd9a54a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:21:21 user nova-compute[75354]: No targets found.
Nov 14 07:21:21 user nova-compute[75354]: iSNS:
Nov 14 07:21:21 user nova-compute[75354]: No targets found.
Nov 14 07:21:21 user nova-compute[75354]: STATIC:
Nov 14 07:21:21 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab
Nov 14 07:21:21 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:21:21 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:21:21 user nova-compute[75354]: FIRMWARE:
Nov 14 07:21:21 user nova-compute[75354]: No targets found.
Nov 14 07:21:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:21:21 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:21:21 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda9cb6a-de8a-4c29-aff6-579d4cac50f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[04451ab4-c477-4f45-8fde-2e59659d7e9b]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab (non-flash)
Nov 14 07:21:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab (non-flash)
Nov 14 07:21:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f809417f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90605bf-d739-44c1-88c6-5094d7d69f57]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e512a57b-9275-495e-b9f4-68435d0a54e5]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2aabe9-24f7-4f4b-96f2-58892b8fb315]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[200a35bb-0897-4644-9b05-5e7662f36891]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0248616-9963-4db7-a12e-ff584b707cc6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8854437a-4778-4d58-94e4-04f83898d70c]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260]
Nov 14 07:21:21 user nova-compute[75354]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab, portal: 172.16.0.220,3260] successful.
Nov 14 07:21:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba4e124-8267-4a07-acd1-5eece253eeab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb49d94-af78-4f0c-a737-4ce91e9ac122]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== disconnect_volume: return (293ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:21:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:21:22 user nova-compute[75354]: DEBUG nova.objects.instance [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:21:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-afaa61da-38f7-4e51-955c-50b47cc08d40 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.603s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:21:24 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:21:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:21:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:46 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 07:21:46 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] There are 0 instances to clean {{(pid=75354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 07:21:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:48 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:50 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:21:50 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 07:21:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:21:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:21:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:21:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:21:52 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:21:53 user nova-compute[75354]: INFO nova.compute.manager [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attaching volume 1ec794d1-0ec0-4fad-85d1-24c15d9a5166 to /dev/vdb
Nov 14 07:21:53 user nova-compute[75354]: DEBUG os_brick.utils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3b9cc-9b35-4d07-a0b5-ba9e675974ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c98d47-ac43-4d8d-8a03-39d37492cb72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec55890-b9b0-4964-be63-8d6a9c755a60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3083530-9949-402e-b3f9-9fbdffccbe29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:21:53 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:21:53 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cad305-3b55-47a4-a16b-f50728faf249]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG os_brick.utils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:21:53 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating existing volume attachment record: 5ef648ef-4939-4d86-b781-eecde30d722e {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:21:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLWBNFTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:21:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:21:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:21:57 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3ca92e-4042-4607-9383-857a14acaa5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:21:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c5cff-9624-42cc-b631-e3dae899835d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166] added
Nov 14 07:21:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b863413-26d5-4bc2-9934-ce3ebe3988b4]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139fa13-e7ca-4fd3-a5d0-38cb7280f86a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLWBNFTe {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLWBNFTe" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ddab5-50ad-4f23-8003-70d68d677618]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLWBNFTe'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b8126-13aa-4d5b-a5d2-fa206d484431]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b881c3-2d11-48f3-acdf-7729443bc2ca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:21:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:21:57 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:21:57 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:21:57 user nova-compute[75354]: 
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e87255-25df-409d-a6fb-01ead0b5efe4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260]
Nov 14 07:21:57 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260] successful.
Nov 14 07:21:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58af4a6-8ebd-4a9a-8155-c81367fe4de6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[596cb638-4669-470c-bc77-41c76abb1cae]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 (non-flash)
Nov 14 07:21:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 (non-flash)
Nov 14 07:21:57 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9fa9a-5aa9-41bf-aceb-4a1fb567b189]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:21:57 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLWBNFTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:21:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:21:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26530323231666665', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:21:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530323231666665', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:21:58 user nova-compute[75354]: DEBUG nova.objects.instance [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:21:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:21:58 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:21:58 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:21:58 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:21:58 user nova-compute[75354]:   <serial>1ec794d1-0ec0-4fad-85d1-24c15d9a5166</serial>
Nov 14 07:21:58 user nova-compute[75354]: </disk>
Nov 14 07:21:58 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:21:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:21:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:21:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No VIF found with MAC fa:16:3e:23:70:78, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:21:59 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-4af91d52-1b93-4526-aa8e-bcc30b2533d9 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.013s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:22:01 user nova-compute[75354]: INFO nova.compute.manager [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Detaching volume 1ec794d1-0ec0-4fad-85d1-24c15d9a5166
Nov 14 07:22:01 user nova-compute[75354]: INFO nova.virt.block_device [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attempting to driver detach volume 1ec794d1-0ec0-4fad-85d1-24c15d9a5166 from mountpoint /dev/vdb
Nov 14 07:22:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Attempting to detach device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:22:01 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:22:01 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:22:01 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:22:01 user nova-compute[75354]:   <serial>1ec794d1-0ec0-4fad-85d1-24c15d9a5166</serial>
Nov 14 07:22:01 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:22:01 user nova-compute[75354]: </disk>
Nov 14 07:22:01 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:22:01 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config.
Nov 14 07:22:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:22:01 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:22:01 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:22:01 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:22:01 user nova-compute[75354]:   <serial>1ec794d1-0ec0-4fad-85d1-24c15d9a5166</serial>
Nov 14 07:22:01 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:22:01 user nova-compute[75354]: </disk>
Nov 14 07:22:01 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:01 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:22:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:15 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:22:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:22:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.12115478515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:22:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 40daef10-7ed8-49cf-b407-01a7c1596317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing inventories for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating ProviderTree inventory for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Updating inventory in ProviderTree for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing aggregate associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, aggregates: None {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Refreshing trait associations for resource provider 639f2b20-6e4a-4044-8740-35d2f7c0a858, traits: COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:22:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:22:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:21 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 is timed out.
Nov 14 07:22:21 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config.
Nov 14 07:22:21 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLWBNFTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:22:21 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95b52a-16c7-4abd-8519-a1de86513853]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:22:21 user nova-compute[75354]: No targets found.
Nov 14 07:22:21 user nova-compute[75354]: iSNS:
Nov 14 07:22:21 user nova-compute[75354]: No targets found.
Nov 14 07:22:21 user nova-compute[75354]: STATIC:
Nov 14 07:22:21 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166
Nov 14 07:22:21 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:22:21 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:22:21 user nova-compute[75354]: FIRMWARE:
Nov 14 07:22:21 user nova-compute[75354]: No targets found.
Nov 14 07:22:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:22:21 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:22:21 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98da1f5-54cb-4a57-b1e3-b53428b7a2fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef2c29-b1d4-4513-9c2b-3a4d5703f4a3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 (non-flash)
Nov 14 07:22:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 (non-flash)
Nov 14 07:22:21 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f80987cf6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84867cff-4bd7-4cb2-b909-9b86b1b40841]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[240ad815-da96-44cb-ab41-55a71a589251]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1492b9c-ed88-483b-a2b0-e51c9e6d708b]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc36020d-aac0-4d4d-8d76-c6abbfd5c0f5]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b62761-0377-431a-bd3d-41c1df9aae9a]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:21 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8203ad0a-9a34-4d11-a2c5-a724f5662c9c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260]
Nov 14 07:22:22 user nova-compute[75354]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166, portal: 172.16.0.220,3260] successful.
Nov 14 07:22:22 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ec794d1-0ec0-4fad-85d1-24c15d9a5166 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[faea8778-e31e-4f84-924a-d5c46331daba]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== disconnect_volume: return (304ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG nova.objects.instance [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:22:22 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-77f2fbba-4537-4a47-abdc-91d4ed0a1d37 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:22:23 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:22:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:22:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:34 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:22:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:22:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:22:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:22:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:22:53 user nova-compute[75354]: DEBUG nova.objects.instance [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:22:53 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:22:54 user nova-compute[75354]: INFO nova.compute.manager [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attaching volume 6a40e204-bf99-4682-94df-b3ec1d61e443 to /dev/vdb
Nov 14 07:22:54 user nova-compute[75354]: DEBUG os_brick.utils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ac2aa7-9183-4fd8-9862-06facd487be0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:59c17e1186a7\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8b29f0-0dc4-4c69-8102-abd25dbefbcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266826b-515d-4a43-8c56-5bef810fbfed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[471976a5-8c09-46d3-a539-f69e0c7f2bc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Running cmd (subprocess): nvme version {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] 'nvme version' failed. Not Retrying. {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] nvme not present on system {{(pid=75354) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 07:22:54 user nova-compute[75354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 07:22:54 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a056d0c8-0456-429c-a7be-c84e49f2e557]: (4, '') {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75354) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] LIGHTOS: no hostnqn found. {{(pid=75354) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG os_brick.utils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:59c17e1186a7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG nova.virt.block_device [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating existing volume attachment record: 7c2e4573-b0b2-4207-8626-b94c5844a698 {{(pid=75354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 07:22:54 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Calling os-brick to attach iSCSI Volume {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adfPhnjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:22:58 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:22:58 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:22:58 user nova-compute[75354]: INFO os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74097e7e-19b7-4289-802f-029e9f336e1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 07:22:58 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --interface default --op new {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1bc36-279c-4d0b-a0a0-534d28873191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443] added\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443] added
Nov 14 07:22:58 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0b0edc-2143-4b91-a8a0-5601c402f4a6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff9abd-3a29-46f2-a28f-8acb26450ba0]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adfPhnjq {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adfPhnjq" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7dd67-3589-4653-b117-1be2c85ad0c6]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'adfPhnjq'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[61544f2e-5bce-4acf-86a1-f267e283d581]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3122b6a-4b71-4823-830c-45910804045e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:22:58 user nova-compute[75354]:  {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 07:22:58 user nova-compute[75354]:  {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:22:58 user nova-compute[75354]: WARNING os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 07:22:58 user nova-compute[75354]: 
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --login {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2079ec-6d1c-4105-821d-79d3f5f42ff2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260]
Nov 14 07:22:58 user nova-compute[75354]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260] successful.
Nov 14 07:22:58 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f36de5-3239-485d-a7d3-a2e227dcdd52]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2220e0f7-e923-46e6-9538-d7bb9c6f5397]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 (non-flash)
Nov 14 07:22:58 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 (non-flash)
Nov 14 07:22:58 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to 172.16.0.220:3260 {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75354) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75354) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[44acd0a9-eca3-492c-8a21-8326b9647c3d]: (4, ('- - 0', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75354) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 07:22:58 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adfPhnjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75354) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 07:22:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:22:59 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23134303636303338', 'path': '/dev/sdb'} {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:22:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134303636303338', 'path': '/dev/sdb'} {{(pid=75354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 07:22:59 user nova-compute[75354]: DEBUG nova.objects.instance [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:22:59 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 07:22:59 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:22:59 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:22:59 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:22:59 user nova-compute[75354]:   <serial>6a40e204-bf99-4682-94df-b3ec1d61e443</serial>
Nov 14 07:22:59 user nova-compute[75354]: </disk>
Nov 14 07:22:59 user nova-compute[75354]:  {{(pid=75354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 07:23:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:23:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 07:23:00 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] No VIF found with MAC fa:16:3e:23:70:78, not building metadata {{(pid=75354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 07:23:00 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-9fb4c051-ca68-4a8b-9a5b-b02ef83b5132 tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.092s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:23:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:23:02 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:23:02 user nova-compute[75354]: INFO nova.compute.manager [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Detaching volume 6a40e204-bf99-4682-94df-b3ec1d61e443
Nov 14 07:23:02 user nova-compute[75354]: INFO nova.virt.block_device [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Attempting to driver detach volume 6a40e204-bf99-4682-94df-b3ec1d61e443 from mountpoint /dev/vdb
Nov 14 07:23:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Attempting to detach device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config. {{(pid=75354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 07:23:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:23:02 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:23:02 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:23:02 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:23:02 user nova-compute[75354]:   <serial>6a40e204-bf99-4682-94df-b3ec1d61e443</serial>
Nov 14 07:23:02 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:23:02 user nova-compute[75354]: </disk>
Nov 14 07:23:02 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:23:02 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the persistent domain config.
Nov 14 07:23:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config. {{(pid=75354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 07:23:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.guest [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 07:23:02 user nova-compute[75354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 07:23:02 user nova-compute[75354]:   <source dev="/dev/sdb"/>
Nov 14 07:23:02 user nova-compute[75354]:   <target dev="vdb" bus="virtio"/>
Nov 14 07:23:02 user nova-compute[75354]:   <serial>6a40e204-bf99-4682-94df-b3ec1d61e443</serial>
Nov 14 07:23:02 user nova-compute[75354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 07:23:02 user nova-compute[75354]: </disk>
Nov 14 07:23:02 user nova-compute[75354]:  {{(pid=75354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 07:23:02 user nova-compute[75354]: DEBUG nova.virt.libvirt.driver [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 07:23:04 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:23:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:23:18 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:23:18 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.120223999023438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:23:18 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Instance 40daef10-7ed8-49cf-b407-01a7c1596317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:23:19 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:23:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:22 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40daef10-7ed8-49cf-b407-01a7c1596317 is timed out.
Nov 14 07:23:22 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully detached device vdb from instance 40daef10-7ed8-49cf-b407-01a7c1596317 from the live domain config.
Nov 14 07:23:22 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] calling os-brick to detach iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f80943de6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adfPhnjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 07:23:22 user nova-compute[75354]: WARNING os_brick.initiator.connectors.base [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 07:23:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2109e-7fdf-4047-b4da-87dfffed1e08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 07:23:22 user nova-compute[75354]: No targets found.
Nov 14 07:23:22 user nova-compute[75354]: iSNS:
Nov 14 07:23:22 user nova-compute[75354]: No targets found.
Nov 14 07:23:22 user nova-compute[75354]: STATIC:
Nov 14 07:23:22 user nova-compute[75354]: Target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443
Nov 14 07:23:22 user nova-compute[75354]:         Portal: 172.16.0.220:3260,-1
Nov 14 07:23:22 user nova-compute[75354]:                 Iface Name: default
Nov 14 07:23:22 user nova-compute[75354]: FIRMWARE:
Nov 14 07:23:22 user nova-compute[75354]: No targets found.
Nov 14 07:23:22 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 07:23:22 user nova-compute[75354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 07:23:22 user nova-compute[75354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75354) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443', 0)] {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[095299b7-72da-4b62-8fd2-9d90d251a738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:22 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[639692ea-9edd-42e7-9655-908707eb4817]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 (non-flash)\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 (non-flash)
Nov 14 07:23:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 (non-flash)
Nov 14 07:23:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8074215ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443'): ({'sdb'}, set())}) {{(pid=75354) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Removing single pathed devices sdb {{(pid=75354) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62e5892-b06e-4de4-8551-8321c0a459bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f2842a-7661-4c7b-b3a0-07fa05cd0b72]: (4, ('ok\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Flushing IO for device /dev/sdb {{(pid=75354) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dea802-61fb-4aec-8ea5-98e0ec42c776]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75354) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0094dc0c-324f-464a-9858-afd9ba40430c]: (4, ('1', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.linuxscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] SCSI volumes sdb have been removed. {{(pid=75354) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443')] {{(pid=75354) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbaf907-1476-42ab-9229-87f35044361d]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --logout {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f5c200-ef3e-465d-a886-aedb2b0defff]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260]
Nov 14 07:23:23 user nova-compute[75354]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443, portal: 172.16.0.220,3260] successful.
Nov 14 07:23:23 user nova-compute[75354]:  stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op delete {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a40e204-bf99-4682-94df-b3ec1d61e443 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG oslo.privsep.daemon [-] privsep: reply[437687ec-90c6-4324-bce8-a041d0a112e9]: (4, ('', '')) {{(pid=85546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75354) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.base [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] <== disconnect_volume: return (332ms) None {{(pid=75354) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Disconnected iSCSI Volume {{(pid=75354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 07:23:23 user nova-compute[75354]: DEBUG nova.objects.instance [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'flavor' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-df5e3df3-db4b-4e75-933a-d51cb9dd149d tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquired lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Forcefully refreshing network info cache for instance {{(pid=75354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG nova.objects.instance [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lazy-loading 'info_cache' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG nova.network.neutron [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [{"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Releasing lock "refresh_cache-40daef10-7ed8-49cf-b407-01a7c1596317" {{(pid=75354) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updated the network info_cache for instance {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 07:23:24 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:23:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:23:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:23:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:23:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:23:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:23:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:05 user nova-compute[75354]: INFO nova.compute.manager [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Terminating instance
Nov 14 07:24:05 user nova-compute[75354]: DEBUG nova.compute.manager [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Start destroying the instance on the hypervisor. {{(pid=75354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef543c71-07f5-4db8-814c-392f0ac7b3d5 req-e0709bfe-9527-4ba3-9234-543506c78dc7 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-vif-unplugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef543c71-07f5-4db8-814c-392f0ac7b3d5 req-e0709bfe-9527-4ba3-9234-543506c78dc7 service nova] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef543c71-07f5-4db8-814c-392f0ac7b3d5 req-e0709bfe-9527-4ba3-9234-543506c78dc7 service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-ef543c71-07f5-4db8-814c-392f0ac7b3d5 req-e0709bfe-9527-4ba3-9234-543506c78dc7 service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef543c71-07f5-4db8-814c-392f0ac7b3d5 req-e0709bfe-9527-4ba3-9234-543506c78dc7 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] No waiting events found dispatching network-vif-unplugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG nova.compute.manager [req-ef543c71-07f5-4db8-814c-392f0ac7b3d5 req-e0709bfe-9527-4ba3-9234-543506c78dc7 service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-vif-unplugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd for instance with task_state deleting. {{(pid=75354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 07:24:05 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [-] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Instance destroyed successfully.
Nov 14 07:24:06 user nova-compute[75354]: DEBUG nova.objects.instance [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lazy-loading 'resources' on Instance uuid 40daef10-7ed8-49cf-b407-01a7c1596317 {{(pid=75354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG nova.virt.libvirt.vif [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T07:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1464801913',display_name='tempest-SnapshotDataIntegrityTests-server-1464801913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1464801913',id=53,image_ref='013c3665-3f76-488b-92b6-f08787e9badf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+wZOsDiAGHFfV/dr2zxA6VFinUVvL2Fchd1pCX8HPcQvrhVcqKs3gOWh7Z1zzZARGIH1xh9Nh7STKKhfmI0YzLZfJM3dViEmMMmLp1pnPjs51+TfrCzDxXZdWN8VRDEw==',key_name='tempest-keypair-1700690887',keypairs=<?>,launch_index=0,launched_at=2023-11-14T07:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77534a98c50e409b88f1cdbaaecd7614',ramdisk_id='',reservation_id='r-t9wjase3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='013c3665-3f76-488b-92b6-f08787e9badf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1851336300',owner_user_name='tempest-SnapshotDataIntegrityTests-1851336300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T07:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16dc2b0e91db449b9c5bb501cf3a4a3f',uuid=40daef10-7ed8-49cf-b407-01a7c1596317,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Converting VIF {"id": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "address": "fa:16:3e:23:70:78", "network": {"id": "28f6a97a-bd30-4257-987e-9055b0e6ac1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-840273810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77534a98c50e409b88f1cdbaaecd7614", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944b529c-2b", "ovs_interfaceid": "944b529c-2b71-46a9-a39e-6cb737f5fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG nova.network.os_vif_util [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b') {{(pid=75354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG os_vif [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b') {{(pid=75354) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap944b529c-2b, bridge=br-int, if_exists=True) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=420f646e-059c-4a56-9b8b-31a5dbc3aa7f) {{(pid=75354) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:06 user nova-compute[75354]: INFO os_vif [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:70:78,bridge_name='br-int',has_traffic_filtering=True,id=944b529c-2b71-46a9-a39e-6cb737f5fbdd,network=Network(28f6a97a-bd30-4257-987e-9055b0e6ac1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944b529c-2b')
Nov 14 07:24:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Deleting instance files /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317_del
Nov 14 07:24:06 user nova-compute[75354]: INFO nova.virt.libvirt.driver [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Deletion of /opt/stack/data/nova/instances/40daef10-7ed8-49cf-b407-01a7c1596317_del complete
Nov 14 07:24:06 user nova-compute[75354]: INFO nova.compute.manager [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 07:24:06 user nova-compute[75354]: DEBUG oslo.service.loopingcall [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75354) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG nova.compute.manager [-] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Deallocating network for instance {{(pid=75354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 07:24:06 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] deallocate_for_instance() {{(pid=75354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG nova.network.neutron [-] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Updating instance_info_cache with network_info: [] {{(pid=75354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 07:24:07 user nova-compute[75354]: INFO nova.compute.manager [-] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Took 0.98 seconds to deallocate network for instance.
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-e7301923-885e-45fe-a474-141296a3c029 req-4b9fbf5c-710c-4156-9351-d367558b755f service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-vif-deleted-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:07 user nova-compute[75354]: INFO nova.scheduler.client.report [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Deleted allocations for instance 40daef10-7ed8-49cf-b407-01a7c1596317
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-09e54fb7-abf5-4a60-b487-9ecf5f1968bd tempest-SnapshotDataIntegrityTests-1851336300 tempest-SnapshotDataIntegrityTests-1851336300-project-member] Lock "40daef10-7ed8-49cf-b407-01a7c1596317" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-0856570d-7a8a-4183-9274-40ae85fa26cc req-eeaaef8e-8429-4fb8-a8c4-56a064b7b44a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received event network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0856570d-7a8a-4183-9274-40ae85fa26cc req-eeaaef8e-8429-4fb8-a8c4-56a064b7b44a service nova] Acquiring lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0856570d-7a8a-4183-9274-40ae85fa26cc req-eeaaef8e-8429-4fb8-a8c4-56a064b7b44a service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [req-0856570d-7a8a-4183-9274-40ae85fa26cc req-eeaaef8e-8429-4fb8-a8c4-56a064b7b44a service nova] Lock "40daef10-7ed8-49cf-b407-01a7c1596317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:07 user nova-compute[75354]: DEBUG nova.compute.manager [req-0856570d-7a8a-4183-9274-40ae85fa26cc req-eeaaef8e-8429-4fb8-a8c4-56a064b7b44a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] No waiting events found dispatching network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd {{(pid=75354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 07:24:07 user nova-compute[75354]: WARNING nova.compute.manager [req-0856570d-7a8a-4183-9274-40ae85fa26cc req-eeaaef8e-8429-4fb8-a8c4-56a064b7b44a service nova] [instance: 40daef10-7ed8-49cf-b407-01a7c1596317] Received unexpected event network-vif-plugged-944b529c-2b71-46a9-a39e-6cb737f5fbdd for instance with vm_state deleted and task_state None.
Nov 14 07:24:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:16 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:16 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:24:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:24:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:24:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=25.147300720214844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:24:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:23 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:25 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:24:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:24:25 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:24:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:31 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:36 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:37 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:24:41 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:46 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:51 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:24:56 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:24:59 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:01 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:02 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:06 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:11 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:25:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 07:25:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75354) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 07:25:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:25:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75354) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 07:25:16 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:18 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:18 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:25:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:25:20 user nova-compute[75354]: WARNING nova.virt.libvirt.driver [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Hypervisor/Node resource view: name=user free_ram=9224MB free_disk=25.137828826904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.compute.provider_tree [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed in ProviderTree for provider: 639f2b20-6e4a-4044-8740-35d2f7c0a858 {{(pid=75354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.scheduler.client.report [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Inventory has not changed for provider 639f2b20-6e4a-4044-8740-35d2f7c0a858 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG nova.compute.resource_tracker [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Compute_service record updated for user:user {{(pid=75354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:25:20 user nova-compute[75354]: DEBUG oslo_concurrency.lockutils [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75354) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:25:21 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 07:25:21 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:24 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Starting heal instance info cache {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:25:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Rebuilding the list of instances to heal {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:25:26 user nova-compute[75354]: DEBUG nova.compute.manager [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Didn't find any instances for network info cache update. {{(pid=75354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:25:26 user nova-compute[75354]: DEBUG oslo_service.periodic_task [None req-11ee2cf7-4e41-4f8d-838a-0a2b707e96a2 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75354) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:25:26 user nova-compute[75354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75354) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}